-- Logs begin at Sun 2022-10-02 00:10:50 UTC, end at Sun 2022-10-02 01:11:28 UTC. -- Oct 02 00:47:08.407947 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:47:08.417616 dv-cinder-master-3-smb devstack@n-api.service[105508]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:47:08 2022] *** Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: nodename: dv-cinder-master-3-smb Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: machine: x86_64 Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: clock source: unix Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: pcre jit disabled Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: detected number of CPU cores: 4 Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: current working directory: / Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:47:08.419710 dv-cinder-master-3-smb devstack@n-api.service[105508]: your processes number limit is 47680 Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: your memory page size is 4096 bytes Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: detected max file descriptor number: 2048 Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: lock engine: pthread robust mutexes Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: thunder lock: enabled Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:47:08.420697 dv-cinder-master-3-smb devstack@n-api.service[105508]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:47:08.459998 dv-cinder-master-3-smb devstack@n-api.service[105508]: Python main interpreter initialized at 0x559de15109c0 Oct 02 00:47:08.459998 dv-cinder-master-3-smb devstack@n-api.service[105508]: python threads support enabled Oct 02 00:47:08.459998 dv-cinder-master-3-smb devstack@n-api.service[105508]: your server socket listen backlog is limited to 100 connections Oct 02 00:47:08.459998 dv-cinder-master-3-smb devstack@n-api.service[105508]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:47:08.460492 dv-cinder-master-3-smb devstack@n-api.service[105508]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:47:08.460492 dv-cinder-master-3-smb devstack@n-api.service[105508]: *** Operational MODE: preforking *** Oct 02 00:47:08.460707 dv-cinder-master-3-smb devstack@n-api.service[105508]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:47:08.460707 dv-cinder-master-3-smb devstack@n-api.service[105508]: spawned uWSGI master process (pid: 105508) Oct 02 00:47:08.460925 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:47:08.461599 dv-cinder-master-3-smb devstack@n-api.service[105508]: spawned uWSGI worker 1 (pid: 105509, cores: 1) Oct 02 00:47:08.462341 dv-cinder-master-3-smb devstack@n-api.service[105508]: spawned uWSGI worker 2 (pid: 105510, cores: 1) Oct 02 00:47:08.462341 dv-cinder-master-3-smb devstack@n-api.service[105508]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:47:09.126689 dv-cinder-master-3-smb devstack@n-api.service[105509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:47:09.142434 dv-cinder-master-3-smb devstack@n-api.service[105510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:47:10.260801 dv-cinder-master-3-smb devstack@n-api.service[105510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:47:10.260801 dv-cinder-master-3-smb devstack@n-api.service[105510]: from cryptography.utils import int_from_bytes Oct 02 00:47:10.261550 dv-cinder-master-3-smb devstack@n-api.service[105510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:47:10.261550 dv-cinder-master-3-smb devstack@n-api.service[105510]: from cryptography.utils import int_from_bytes Oct 02 00:47:10.265782 dv-cinder-master-3-smb devstack@n-api.service[105509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:47:10.265782 dv-cinder-master-3-smb devstack@n-api.service[105509]: from cryptography.utils import int_from_bytes Oct 02 00:47:10.266229 dv-cinder-master-3-smb devstack@n-api.service[105509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:47:10.266229 dv-cinder-master-3-smb devstack@n-api.service[105509]: from cryptography.utils import int_from_bytes Oct 02 00:47:12.906387 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:47:12.907025 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:47:12.907166 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:47:12.907525 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:47:12.907779 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:47:12.908172 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.908494 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.908815 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.909164 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.909498 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.909808 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.910131 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.910451 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.910779 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.910975 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:47:12.911347 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.911441 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:47:12.911535 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.911654 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.911766 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:47:12.911975 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.912258 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:47:12.912346 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.912579 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.912688 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:47:12.912896 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.913144 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.913237 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.913535 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.913622 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.913845 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.914088 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.914343 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.914579 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.914783 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915031 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915159 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915389 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915512 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915728 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.915890 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.916034 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.916338 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.916429 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.916657 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.916845 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917003 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917280 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917373 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917594 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917682 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.917921 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918032 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918247 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918346 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918555 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918651 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918866 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.918969 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.919182 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.919300 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.919486 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.919609 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.920493 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.920827 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921057 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921180 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921310 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921492 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921821 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.921917 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.922141 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.922238 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.922468 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.922658 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.922781 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.923084 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.923196 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.923390 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.923584 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.923682 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924005 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924116 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924313 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924525 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924614 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924852 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.924992 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.925183 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.925419 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.925509 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.925813 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.925900 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.926134 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.926326 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.926434 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.926622 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.926911 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927008 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927250 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927368 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927564 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927686 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927868 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.927978 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.928177 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.928395 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.928490 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.928708 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.928794 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929050 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929141 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929374 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929459 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929677 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929776 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.929997 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930091 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930309 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930395 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930630 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930738 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.930934 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931018 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931252 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931345 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931552 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931648 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931860 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.931946 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932169 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932262 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932488 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932582 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932795 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.932879 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933126 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933212 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933378 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933475 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933685 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.933783 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934007 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934107 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934330 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934431 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934633 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934718 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934885 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.934970 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.935135 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.935292 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.935655 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.935949 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936036 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936288 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936404 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936596 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936697 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.936907 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937063 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937238 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937328 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937548 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937637 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937862 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.937973 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938166 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938272 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938471 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938575 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938774 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.938868 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939080 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939175 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939384 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939478 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939691 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.939786 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940001 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940116 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940302 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940391 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940610 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940722 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.940916 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941067 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941241 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941335 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941560 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941659 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941882 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.941978 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942190 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942292 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942496 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942594 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942805 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.942953 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943093 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943192 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943396 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943539 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943702 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.943795 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944006 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944093 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944327 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944445 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944625 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944723 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944875 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.944994 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945205 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945294 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945507 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945602 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945825 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.945921 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946131 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946220 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946430 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946517 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946732 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.946824 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947030 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947139 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947337 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947424 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947640 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947728 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.947944 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948043 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948245 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948332 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948550 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948657 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948851 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.948975 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949176 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949279 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949478 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949573 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949794 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.949894 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950081 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950189 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950398 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950498 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950706 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.950792 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.951053 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.951176 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.951360 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.951679 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.951943 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.952087 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.952260 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.952401 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.952573 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.952721 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.952904 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.953042 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.953281 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.953386 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.953548 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.953648 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.953871 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.953958 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.954179 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.954264 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.954488 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.954582 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.954809 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.954911 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.955143 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.955288 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.955425 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.955533 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.955731 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.955819 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.956032 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.956128 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.956339 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.956435 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.956657 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.956751 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.956982 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.957180 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.957279 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.957363 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.957586 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.957675 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.957888 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.958006 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.958194 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.958294 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.958496 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.958585 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.958798 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.958900 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.959102 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.959197 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.959400 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.959505 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.959716 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.959813 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.960055 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.960175 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.960343 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.960439 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.960651 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.960760 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.960972 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.961099 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.961295 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:47:12.961406 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.961616 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.961762 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.961950 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962058 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962258 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962347 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962568 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962667 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962889 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.962987 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963199 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963296 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963522 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963625 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963833 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.963930 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964143 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964231 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964457 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964564 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964764 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.964874 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965093 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965188 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965403 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965496 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965723 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.965825 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.966042 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.966138 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.966357 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.966460 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.967205 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.967522 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.967709 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.967841 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968042 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968154 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968376 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968498 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968690 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.968829 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969038 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969132 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969367 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969463 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969676 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969887 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.969980 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970062 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970292 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970398 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970619 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970717 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.970926 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971027 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971259 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971349 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971567 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971664 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971877 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.971964 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972185 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972272 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972492 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972579 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972797 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.972882 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973133 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973224 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973446 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973544 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973756 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.973862 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974066 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974161 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974372 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974460 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974682 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974790 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.974986 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975092 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975292 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975385 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975598 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975692 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.975904 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976010 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976214 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976308 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976522 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976618 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976831 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.976961 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977165 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977257 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977477 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977570 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977790 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.977886 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978098 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978184 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978406 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978490 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978716 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.978814 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979023 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979116 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979325 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979411 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979627 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979714 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.979935 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980020 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980241 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980354 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980544 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980644 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980848 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.980962 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981177 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981262 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981487 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981607 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981792 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.981879 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.982099 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.982314 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983034 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983161 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983344 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983654 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983802 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.983960 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984123 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984286 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984444 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984596 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984763 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.984901 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.988460 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.988622 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.988729 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.988824 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.988916 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989077 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989174 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989262 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989262 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989418 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989502 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989593 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989678 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989762 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989853 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989937 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.989937 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990094 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990185 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990276 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990348 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990483 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990579 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990664 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990748 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990832 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.990916 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991000 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991104 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991194 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991277 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991361 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991445 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991528 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991715 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.991848 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992039 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992144 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992347 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992450 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992657 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992759 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.992981 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993137 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993295 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993444 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993602 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993749 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.993892 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994040 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994183 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994330 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994491 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994638 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994782 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.994885 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995085 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995232 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995374 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995509 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995677 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995807 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.995978 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996125 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996299 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996446 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996605 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996743 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.996909 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997063 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997240 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997328 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997542 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997635 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.997951 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998082 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998268 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998592 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998777 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998898 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.998999 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999214 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999308 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999546 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999638 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999880 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:12.999978 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000194 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000297 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000514 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000640 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000836 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.000967 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001171 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001271 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001484 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001578 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001795 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.001908 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002096 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002191 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002408 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002518 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002716 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.002813 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003023 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003122 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003337 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003487 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003642 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003765 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.003945 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004092 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004252 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004355 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004561 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004648 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.004863 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005075 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005176 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005273 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005488 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005579 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005810 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.005906 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006121 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006219 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006440 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006533 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006748 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.006842 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007051 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007148 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007354 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007449 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007663 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007828 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.007970 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.008119 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.008262 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.008402 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.008559 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.008917 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009144 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009243 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009462 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009554 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009773 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.009866 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010075 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010166 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010375 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010465 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010686 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010782 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.010993 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011078 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011309 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011400 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011619 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011711 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.011926 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012017 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012246 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012331 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012551 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012643 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.012861 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013014 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013194 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013282 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013624 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013808 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.013967 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014160 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014259 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014467 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014560 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014775 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.014863 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015087 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015225 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015397 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015489 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015702 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.015789 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016011 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016097 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016322 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016416 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016627 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.016903 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017084 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017256 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017348 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017580 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017676 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017892 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.017993 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018214 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018301 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018534 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018632 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018877 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.018974 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019143 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019239 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019464 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019561 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019772 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.019873 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020075 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020169 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020380 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020479 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020681 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.020780 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021015 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021103 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021327 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021422 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021632 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021722 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.021936 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022020 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022249 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022336 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022554 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022646 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022860 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.022947 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023165 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023259 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023471 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023563 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023785 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.023875 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024092 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024178 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024397 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024488 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024702 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.024794 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025032 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025119 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025343 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025428 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025650 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025746 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.025960 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026059 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026266 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026357 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026576 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026688 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026890 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.026984 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027193 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027278 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027499 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027667 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027816 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.027939 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.028173 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.028388 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.028482 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.028729 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.028821 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.029663 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.029769 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.029926 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030150 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030239 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030526 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030617 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030835 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.030933 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031138 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031236 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031447 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031533 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031755 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.031843 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032071 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032203 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032376 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032470 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032681 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.032805 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033003 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033110 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033311 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033397 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033615 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033708 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.033922 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034020 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034224 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034310 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034527 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034611 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034828 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.034920 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035131 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035223 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035431 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035528 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035734 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.035825 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036033 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036119 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036339 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036432 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036640 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036737 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.036962 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037061 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037267 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037359 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037575 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037667 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037877 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.037967 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038182 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038284 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038483 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038569 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038799 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.038890 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039104 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039200 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039407 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039500 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039715 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.039812 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040016 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040111 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040318 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040403 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040625 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040711 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.040964 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041069 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041283 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041369 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041583 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041674 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041887 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.041974 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042187 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042273 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042490 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042574 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042790 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.042875 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043096 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043180 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043395 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043480 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043698 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043787 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.043998 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.044085 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.044296 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.044389 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.044594 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.044815 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.045587 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.045681 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046058 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046157 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046422 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046508 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046733 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.046823 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047038 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047136 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047350 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047436 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047658 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047742 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.047961 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048058 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048269 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048363 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048571 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048657 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.048887 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049007 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049218 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049310 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049522 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049607 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049826 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.049931 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050130 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050215 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050436 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050532 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050736 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.050831 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051058 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051155 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051361 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051446 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051662 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051748 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.051963 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052048 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052268 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052362 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052568 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052655 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.052868 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053038 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053202 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053300 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053523 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053609 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053829 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.053928 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054127 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054222 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054433 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054519 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054735 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.054821 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055037 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055204 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055343 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055468 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055652 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055774 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.055951 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056061 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056251 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056367 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056557 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056647 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056857 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.056970 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057185 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057273 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057494 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057595 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057804 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.057906 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058106 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058279 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058415 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058546 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058696 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.058831 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059021 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059151 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059319 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059449 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059625 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059760 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.059982 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.060128 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.060358 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.060500 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.060821 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.060983 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061170 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061312 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061488 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061629 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061795 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.061946 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062108 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062253 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062424 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062569 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062743 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.062878 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063059 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063191 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063369 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063496 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063789 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.063882 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064104 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064190 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064414 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064507 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064723 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.064810 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065050 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065141 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065359 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065448 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065674 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065772 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.065975 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066066 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066283 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066370 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066588 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066674 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066893 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.066978 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067203 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067289 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067508 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067598 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067816 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.067899 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068125 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068240 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068436 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068557 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068748 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.068865 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069089 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069307 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069394 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069620 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069712 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.069933 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070030 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070262 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070396 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070583 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070670 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070879 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.070968 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071182 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071276 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071491 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071578 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071794 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.071881 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072104 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072189 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072407 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072501 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072726 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.072842 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073065 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073167 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073375 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073474 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073703 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.073803 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074030 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074115 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074349 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074444 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074675 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074813 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.074991 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.075078 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.075299 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.075393 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.075702 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.075783 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.076549 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.076651 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.076879 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077149 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077236 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077503 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077590 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077816 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.077916 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078124 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078237 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078438 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078527 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078760 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.078852 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079065 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079160 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079374 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079468 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079681 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079810 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.079988 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080088 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080292 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080389 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080593 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080692 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.080915 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081062 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081243 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081347 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081566 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081653 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.081880 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082037 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082203 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082353 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082526 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082667 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082830 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.082994 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083152 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083320 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083464 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083648 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083770 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.083957 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084074 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084276 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084368 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084588 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084709 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.084913 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085077 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085266 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085353 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085577 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085665 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085893 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.085978 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086198 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086290 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086531 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086625 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086855 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.086941 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087169 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087255 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087493 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087579 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087816 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.087900 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088145 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088243 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088457 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088580 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088763 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.088857 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089106 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089211 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089413 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089499 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089720 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.089806 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090026 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090121 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090331 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090464 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090630 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090722 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.090930 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.091029 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.091232 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.091318 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.091605 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.091701 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092077 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092164 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092409 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092566 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092722 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.092878 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093054 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093213 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093365 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093541 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093672 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.093847 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094017 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094171 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094323 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094488 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094655 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094812 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.094967 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095133 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095293 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095438 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095611 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095754 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.095927 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096052 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096241 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096351 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096558 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096653 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096876 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.096993 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097219 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097306 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097539 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097633 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097853 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.097947 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098171 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098258 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098493 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098589 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098813 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.098910 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.099151 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.099362 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.099478 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.099693 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.099800 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100010 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100103 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100325 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100463 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100637 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100734 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.100979 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101083 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101289 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101385 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101602 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101688 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.101912 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102006 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102218 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102313 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102521 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102607 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102828 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.102913 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103130 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103245 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103431 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103520 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103732 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.103826 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104054 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104142 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104358 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104444 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104679 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.104764 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105008 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105099 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105313 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105410 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105616 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105711 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.105918 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106006 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106260 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106355 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106562 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106656 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106875 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.106960 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.107715 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.107840 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108035 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108278 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108432 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108641 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108750 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.108977 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109095 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109292 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109391 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109609 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109698 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.109923 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110029 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110237 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110325 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110558 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110719 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.110855 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111077 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111216 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111350 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111490 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111575 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111778 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.111877 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.112309 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.112458 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.112631 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.112769 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.112957 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113059 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113286 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113381 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113601 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113688 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.113916 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114020 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114229 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114325 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114540 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114635 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114850 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.114949 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115156 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115242 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115465 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115558 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115776 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.115870 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116081 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116167 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116404 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116508 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116717 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.116804 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117047 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117138 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117371 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117473 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117681 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117784 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.117994 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118215 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118351 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118564 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118649 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118888 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.118979 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119216 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119321 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119541 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119628 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119861 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.119947 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120168 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120266 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120478 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120564 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120785 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.120879 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121114 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121210 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121423 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121563 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121731 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.121817 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122036 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122130 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122342 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122428 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122651 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.122845 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.123592 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.123764 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.123874 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.124234 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.124366 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.124565 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.124677 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.124888 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125030 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125238 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125324 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125635 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125770 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.125940 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126085 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126254 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126419 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126559 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126753 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.126867 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127078 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127165 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127400 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127501 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127718 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.127804 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128046 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128139 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128353 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128439 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128654 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128745 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.128983 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129074 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129297 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129393 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129601 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129686 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.129922 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130015 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130231 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130325 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130532 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130625 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130838 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.130928 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.131145 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.131231 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.131456 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.131682 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.131804 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132031 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132131 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132349 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132438 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132673 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.132771 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.133021 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.133115 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.133344 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.133564 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.133917 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134162 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134265 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134483 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134572 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134808 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.134896 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135122 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135219 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135431 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135520 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135734 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.135822 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136037 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136127 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136345 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136449 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136658 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136758 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.136972 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137065 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137284 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137382 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137586 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137681 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137893 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.137981 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.138202 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.138298 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.138531 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.138628 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.138997 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139088 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139323 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139476 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139629 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139787 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.139940 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140095 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140251 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140402 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140563 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140709 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.140882 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.141119 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.141285 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.141423 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.141561 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.141865 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142005 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142148 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142263 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142347 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142441 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142557 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142762 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.142890 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143072 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143190 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143382 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143490 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143695 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.143819 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144002 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144111 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144319 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144433 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144633 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.144741 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145018 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145129 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145277 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145391 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145648 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.145995 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146114 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146303 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146410 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146631 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146868 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.146969 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147208 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147320 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147533 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147641 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147871 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.147969 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148187 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148297 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148573 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148678 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148814 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.148979 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149144 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149234 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149471 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149558 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149783 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.149884 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150097 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150193 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150407 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150495 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150712 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.150797 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151019 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151153 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151327 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151421 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151634 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151728 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.151944 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152029 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152247 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152331 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152555 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152679 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152860 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.152968 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153192 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153288 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153497 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153594 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153805 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.153895 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.154133 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.154229 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.154444 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.154667 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.154754 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155039 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155183 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155343 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155478 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155648 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155799 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.155957 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156121 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156255 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156483 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156577 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156808 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.156899 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157076 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157166 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157388 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157475 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157707 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.157819 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158038 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158143 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158348 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158435 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158655 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158741 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.158999 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.159318 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.159409 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.159629 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.159741 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.159949 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160036 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160258 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160353 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160567 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160653 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160887 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.160992 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161229 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161327 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161539 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161631 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161862 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.161965 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162170 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162256 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162481 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162575 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162794 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.162889 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163104 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163190 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163416 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163502 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163729 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.163834 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164036 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164130 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164341 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164427 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164649 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164737 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.164989 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165080 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165303 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165388 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165609 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165697 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.165911 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166000 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166221 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166316 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166522 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166610 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166837 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.166958 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167141 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167254 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167444 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167544 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167750 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.167848 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168052 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168161 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168354 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168460 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168656 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168796 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.168976 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.169121 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.169283 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.169371 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.169584 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.170409 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.170587 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.170681 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.170764 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171019 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171115 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171336 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171514 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171641 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171728 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.171950 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172036 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172257 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172352 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172594 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172680 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.172927 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173036 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173268 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173372 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173581 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173667 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173887 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.173989 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.174129 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:47:13.174225 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.174502 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.174829 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.175148 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.175463 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.175774 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.176108 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.176422 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.176730 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.177145 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.177452 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.177778 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.178085 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.178413 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.178737 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.179050 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.179375 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.179691 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.180011 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.180327 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.180640 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.180993 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.181307 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.181621 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.181929 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.182237 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.182548 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.182865 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.183176 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.183486 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.183803 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.184118 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.184443 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.184770 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.185107 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.186141 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.186543 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.186891 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.187214 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.187561 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.187895 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.190255 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.190601 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.190926 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:47:13.191181 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:47:13.336006 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO dbcounter [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Registered counter for database nova_api Oct 02 00:47:13.350607 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO dbcounter [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Registered counter for database nova_api Oct 02 00:47:13.358587 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_db.sqlalchemy.engines [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.365406 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writer thread running {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.370788 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_db.sqlalchemy.engines [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.377589 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writer thread running {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.424364 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.context [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=105509) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:47:13.428288 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:47:13.428761 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:47:13.430348 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:47:13.431070 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:47:13.431512 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:47:13.433530 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:47:13.436166 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO dbcounter [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Registered counter for database nova_cell0 Oct 02 00:47:13.440445 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO dbcounter [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Registered counter for database nova_cell1 Oct 02 00:47:13.444791 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.context [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=105510) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:47:13.447721 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_db.sqlalchemy.engines [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.448909 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:47:13.449433 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:47:13.450249 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_db.sqlalchemy.engines [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.451043 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:47:13.452165 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:47:13.452625 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:47:13.454685 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_concurrency.lockutils [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:47:13.455112 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writer thread running {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.456769 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO dbcounter [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Registered counter for database nova_cell0 Oct 02 00:47:13.458361 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writer thread running {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.461060 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO dbcounter [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Registered counter for database nova_cell1 Oct 02 00:47:13.469745 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_db.sqlalchemy.engines [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.471288 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_db.sqlalchemy.engines [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.478118 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writer thread running {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.479593 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writer thread running {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.605012 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO dbcounter [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Registered counter for database nova_cell0 Oct 02 00:47:13.614887 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_db.sqlalchemy.engines [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.619916 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writer thread running {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.627329 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO dbcounter [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Registered counter for database nova_cell0 Oct 02 00:47:13.634460 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG oslo_db.sqlalchemy.engines [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:47:13.639476 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writer thread running {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:47:13.965840 dv-cinder-master-3-smb devstack@n-api.service[105509]: WARNING keystonemiddleware.auth_token [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:47:13.969250 dv-cinder-master-3-smb devstack@n-api.service[105510]: WARNING keystonemiddleware.auth_token [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:47:13.973915 dv-cinder-master-3-smb devstack@n-api.service[105509]: WARNING keystonemiddleware.auth_token [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:47:13.976718 dv-cinder-master-3-smb devstack@n-api.service[105510]: WARNING keystonemiddleware.auth_token [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:47:14.324055 dv-cinder-master-3-smb devstack@n-api.service[105510]: WARNING keystonemiddleware.auth_token [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:47:14.326967 dv-cinder-master-3-smb devstack@n-api.service[105509]: WARNING keystonemiddleware.auth_token [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:47:14.330222 dv-cinder-master-3-smb devstack@n-api.service[105510]: WARNING keystonemiddleware.auth_token [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:47:14.332988 dv-cinder-master-3-smb devstack@n-api.service[105509]: WARNING keystonemiddleware.auth_token [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:47:14.335488 dv-cinder-master-3-smb devstack@n-api.service[105510]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559de15109c0 pid: 105510 (default app) Oct 02 00:47:14.337641 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:14.338843 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-a5ccd585-a4df-4c25-8704-8f78046b249b None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001828 Oct 02 00:47:14.339226 dv-cinder-master-3-smb devstack@n-api.service[105509]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559de15109c0 pid: 105509 (default app) Oct 02 00:47:14.339338 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sun Oct 2 00:47:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:44.278134 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:44.279492 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Oct 02 00:48:44.279939 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:44.301324 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_api:SELECT=3 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.302235 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_cell1:SELECT=3 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.303235 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_cell0:SELECT=3 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.303948 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_cell0:SELECT=3 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:45.402099 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-452aa7d4-06c0-4a0d-978c-eb6e0d56ae72 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:45.438246 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-452aa7d4-06c0-4a0d-978c-eb6e0d56ae72 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.147505 Oct 02 00:48:45.439101 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 2 00:48:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:48.284562 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:48.288364 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-17604d40-8df7-4286-9aed-aee16ce77d59 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 02 00:48:48.288364 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:48.898709 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-22b40ba7-e5f9-47ed-9a97-ab5dac535d06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:48.954220 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-22b40ba7-e5f9-47ed-9a97-ab5dac535d06 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.660198 Oct 02 00:48:48.954790 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:48.969619 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=3 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.970432 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_cell0:SELECT=3 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.973393 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_cell1:SELECT=3 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.974231 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:49.195988 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-de024d12-7818-4f64-b043-471684b040dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:49.271213 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-de024d12-7818-4f64-b043-471684b040dd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306883 Oct 02 00:48:49.271814 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 2 00:48:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:52.064749 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-22b40ba7-e5f9-47ed-9a97-ab5dac535d06 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:52.066797 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-22b40ba7-e5f9-47ed-9a97-ab5dac535d06 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002469 Oct 02 00:48:52.067538 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:52.953106 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-df3cb9e2-6d12-4557-869c-7936fb227869 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "disk": 5, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:53.020112 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-df3cb9e2-6d12-4557-869c-7936fb227869 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.945055 Oct 02 00:48:53.020883 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:53.034193 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-91c1984d-405e-4e4c-a2af-67b2943cb417 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:53.086664 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-91c1984d-405e-4e4c-a2af-67b2943cb417 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056760 Oct 02 00:48:53.088365 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 2 00:48:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:56.162635 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-df3cb9e2-6d12-4557-869c-7936fb227869 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:56.164428 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-df3cb9e2-6d12-4557-869c-7936fb227869 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002465 Oct 02 00:48:56.165771 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:56.794015 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-18ec5bc1-d0d3-4cd3-93b4-0dd14e3e253a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:56.816176 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-18ec5bc1-d0d3-4cd3-93b4-0dd14e3e253a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.640154 Oct 02 00:48:56.816736 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:56.833357 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-acf4df82-50d3-4767-b91b-a5878a485bea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:56.869870 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-acf4df82-50d3-4767-b91b-a5878a485bea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040859 Oct 02 00:48:56.870524 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 2 00:48:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:59.810044 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-18ec5bc1-d0d3-4cd3-93b4-0dd14e3e253a admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:59.811037 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-18ec5bc1-d0d3-4cd3-93b4-0dd14e3e253a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 02 00:48:59.811614 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:49:00.428536 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-3b4c6ec8-bf4c-4e7b-92d0-6a0a14fe7148 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:00.450051 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-3b4c6ec8-bf4c-4e7b-92d0-6a0a14fe7148 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.631716 Oct 02 00:49:00.450615 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:49:00.471138 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-bd650e80-5564-4b89-85f5-7a355986d93a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:00.500801 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-bd650e80-5564-4b89-85f5-7a355986d93a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036241 Oct 02 00:49:00.512662 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 2 00:49:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:03.564997 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-3b4c6ec8-bf4c-4e7b-92d0-6a0a14fe7148 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:03.566393 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-3b4c6ec8-bf4c-4e7b-92d0-6a0a14fe7148 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Oct 02 00:49:03.566984 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:04.262504 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:04.285556 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710213 Oct 02 00:49:04.286160 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:04.300155 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-e09236ef-6f7f-4182-856f-13bf6777f753 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:04.331061 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-e09236ef-6f7f-4182-856f-13bf6777f753 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034751 Oct 02 00:49:04.331830 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 2 00:49:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:49:07.465721 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:07.467422 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Oct 02 00:49:07.467844 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:08.012138 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-76828e8e-6fb3-417c-a59f-e924155def92 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:08.042068 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-76828e8e-6fb3-417c-a59f-e924155def92 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.567304 Oct 02 00:49:08.042648 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 2 00:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:49:10.804150 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:10.805805 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-cd1c5e26-7714-402c-9f73-d1f373f0b0c6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Oct 02 00:49:10.806221 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:49:11.338037 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-d34e8eb6-51f3-4a2b-b8f7-03192517d579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:11.365613 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-d34e8eb6-51f3-4a2b-b8f7-03192517d579 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.552334 Oct 02 00:49:11.367988 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:11.390508 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-eedc5ef4-2685-407b-b926-9127a17d992c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:11.444689 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-eedc5ef4-2685-407b-b926-9127a17d992c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057010 Oct 02 00:49:11.446560 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 2 00:49:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:14.500864 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-d34e8eb6-51f3-4a2b-b8f7-03192517d579 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:14.501892 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-d34e8eb6-51f3-4a2b-b8f7-03192517d579 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 02 00:49:14.502294 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:49:14.907613 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-2c9d93fa-f7fb-41fa-ab8a-14691771a411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:14.913356 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.932195 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-2c9d93fa-f7fb-41fa-ab8a-14691771a411 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422594 Oct 02 00:49:14.932771 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:14.944751 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-f4a89384-0ad5-4c14-ab36-d0b713e1f43c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:14.971214 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-f4a89384-0ad5-4c14-ab36-d0b713e1f43c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029895 Oct 02 00:49:14.971705 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 2 00:49:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:17.813592 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-2c9d93fa-f7fb-41fa-ab8a-14691771a411 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:17.815410 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-2c9d93fa-f7fb-41fa-ab8a-14691771a411 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002461 Oct 02 00:49:17.815983 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:18.383028 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-48db910e-dc4a-48fd-b4b3-cea7b2b17ee1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:18.409408 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-48db910e-dc4a-48fd-b4b3-cea7b2b17ee1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.586586 Oct 02 00:49:18.410781 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:18.423471 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-a44491fa-e3cf-4ef2-a512-146343730e9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:18.457446 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-a44491fa-e3cf-4ef2-a512-146343730e9b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035626 Oct 02 00:49:18.472991 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 2 00:49:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:21.226315 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-48db910e-dc4a-48fd-b4b3-cea7b2b17ee1 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:21.228201 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-48db910e-dc4a-48fd-b4b3-cea7b2b17ee1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002346 Oct 02 00:49:21.228864 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:21.787704 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-b6090f73-0b2c-4d12-9aae-af3948bf3842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:21.822640 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-b6090f73-0b2c-4d12-9aae-af3948bf3842 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.586516 Oct 02 00:49:21.832332 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:49:21.838815 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-a63dfbed-a0ff-4415-bc55-90777230329c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:21.849932 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:21.880595 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-a63dfbed-a0ff-4415-bc55-90777230329c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045306 Oct 02 00:49:21.881855 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 2 00:49:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:24.771596 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-b6090f73-0b2c-4d12-9aae-af3948bf3842 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:24.774717 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-b6090f73-0b2c-4d12-9aae-af3948bf3842 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003813 Oct 02 00:49:24.775669 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:25.409704 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:25.442438 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.659726 Oct 02 00:49:25.443968 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 2 00:49:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:49:25.458691 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-58804f22-039a-4db8-a7af-31ca568b34f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:25.506596 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-58804f22-039a-4db8-a7af-31ca568b34f6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053399 Oct 02 00:49:25.507762 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 2 00:49:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:49:43.215455 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:43.216478 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 02 00:49:43.216883 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:43.229111 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:43.673806 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-5130955e-3050-4c3e-88c9-a189a470366d admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:43.697033 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-5130955e-3050-4c3e-88c9-a189a470366d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.472613 Oct 02 00:49:43.697577 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 2 00:49:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:45.095377 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:45.096512 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-57c2436b-00b3-4730-a116-9083d468a602 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 02 00:49:45.096792 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:45.763330 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-ddac97c0-dc3a-405a-a98f-0fd749e723e1 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:45.768638 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.wsgi [None req-ddac97c0-dc3a-405a-a98f-0fd749e723e1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-ddac97c0-dc3a-405a-a98f-0fd749e723e1 admin admin] Request method failure captured: Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept: application/json Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept-Encoding: gzip, deflate Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Connection: keep-alive Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Content-Length: 0 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Host: 10.222.0.26 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-System-Scope: None Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: User-Agent: python-novaclient Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Auth-Token: gAAAAABjOOAoJZ_a46UbPjbM1vLVs_jdUq8Cq9Y60bX5K470xjMQ3tIoAn2xy3tMMJs3dY6ETmepYEq5UKliFfZT92SebLO9Il6GM4bM8C9tQlUhQsvx-nv3k8xeHFiQ_32RhxB6_DJXc7hMkDgKPX0TrR5ebqTcu0vfPKSpHUkNGHxENpfy8YM Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Id: None Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Name: None Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Identity-Status: Confirmed Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Is-Admin-Project: True Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Id: default Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Name: Default Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Name: admin Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Role: member,admin,reader Oct 02 00:49:45.772698 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Roles: member,admin,reader Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant: admin Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Name: admin Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User: admin Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Id: default Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Name: Default Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Name: admin Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: method: > Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: exception: Flavor 42 could not be found. Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: action_args: {'id': '42'} Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:45.774275 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:45.775199 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.776594 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-ddac97c0-dc3a-405a-a98f-0fd749e723e1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:45.777891 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-ddac97c0-dc3a-405a-a98f-0fd749e723e1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.536774 Oct 02 00:49:45.777891 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 2 00:49:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:45.784050 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-09f3a996-c407-4958-801c-87999ea3bf9f admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:45.788436 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:45.807984 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-09f3a996-c407-4958-801c-87999ea3bf9f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027550 Oct 02 00:49:45.808547 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:45.819783 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-c5550828-5cf8-4f54-8f8a-6d08f0328458 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:45.841889 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-c5550828-5cf8-4f54-8f8a-6d08f0328458 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027117 Oct 02 00:49:45.842430 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:45.852447 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-9c0c2ef9-9448-4b97-9c1e-780a1d1234d2 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:45.858539 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.wsgi [None req-9c0c2ef9-9448-4b97-9c1e-780a1d1234d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-9c0c2ef9-9448-4b97-9c1e-780a1d1234d2 admin admin] Request method failure captured: Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept: application/json Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept-Encoding: gzip, deflate Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Connection: keep-alive Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Content-Length: 0 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Host: 10.222.0.26 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-System-Scope: None Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: User-Agent: python-novaclient Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Auth-Token: gAAAAABjOOAoJZ_a46UbPjbM1vLVs_jdUq8Cq9Y60bX5K470xjMQ3tIoAn2xy3tMMJs3dY6ETmepYEq5UKliFfZT92SebLO9Il6GM4bM8C9tQlUhQsvx-nv3k8xeHFiQ_32RhxB6_DJXc7hMkDgKPX0TrR5ebqTcu0vfPKSpHUkNGHxENpfy8YM Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Id: None Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Name: None Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Identity-Status: Confirmed Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Is-Admin-Project: True Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Id: default Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Name: Default Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Name: admin Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Role: member,admin,reader Oct 02 00:49:45.861793 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Roles: member,admin,reader Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant: admin Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Name: admin Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User: admin Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Id: default Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Name: Default Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Name: admin Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: method: > Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: exception: Flavor 42 could not be found. Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: action_args: {'id': '42'} Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:45.863353 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:45.864616 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:45.866670 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-9c0c2ef9-9448-4b97-9c1e-780a1d1234d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:45.868032 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-9c0c2ef9-9448-4b97-9c1e-780a1d1234d2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014894 Oct 02 00:49:45.868032 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 2 00:49:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:47.136120 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-c5550828-5cf8-4f54-8f8a-6d08f0328458 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:47.137206 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-c5550828-5cf8-4f54-8f8a-6d08f0328458 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 02 00:49:47.137638 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:47.700476 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-cbca48af-47e3-4f1c-83d8-a7a10fae57af admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:47.705734 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.wsgi [None req-cbca48af-47e3-4f1c-83d8-a7a10fae57af admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-cbca48af-47e3-4f1c-83d8-a7a10fae57af admin admin] Request method failure captured: Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept: application/json Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept-Encoding: gzip, deflate Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Connection: keep-alive Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Content-Length: 0 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Host: 10.222.0.26 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-System-Scope: None Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: User-Agent: python-novaclient Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Auth-Token: gAAAAABjOOArdJ5A6HTarrhkhG0--JYs_gvesEaQSrMgP59CPgKUGhKN72wraKbRuDG4rOZz5xy6SJ3hqFS8wKWOFFA_N1NrCsHO98pwKZOnr3GIJYo_oOaE5hUDojuKfNAZfgjzT2r-mMZER_hSNW3Ajhun8CvvvzUZAeUxRE_8IGxA3T9RF0I Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Id: None Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Name: None Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Identity-Status: Confirmed Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Is-Admin-Project: True Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Id: default Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Name: Default Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Name: admin Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Role: member,admin,reader Oct 02 00:49:47.707295 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Roles: member,admin,reader Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant: admin Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Name: admin Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User: admin Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Id: default Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Name: Default Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Name: admin Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: method: > Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: exception: Flavor 84 could not be found. Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: action_args: {'id': '84'} Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:47.708959 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:47.710799 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.712372 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-cbca48af-47e3-4f1c-83d8-a7a10fae57af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:47.713549 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-cbca48af-47e3-4f1c-83d8-a7a10fae57af admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.432277 Oct 02 00:49:47.713549 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 2 00:49:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:47.721710 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-18578240-e513-4d60-9e8b-a781e1d8208e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:47.738904 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-18578240-e513-4d60-9e8b-a781e1d8208e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021002 Oct 02 00:49:47.739470 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:49:47.749297 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-5114f73a-84d9-42bf-b8c7-4c724e128c0d admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:47.766038 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-5114f73a-84d9-42bf-b8c7-4c724e128c0d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020231 Oct 02 00:49:47.766605 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:47.777037 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-c8be0bd3-c763-4c9e-8953-40ade86589b0 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:47.782050 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.wsgi [None req-c8be0bd3-c763-4c9e-8953-40ade86589b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-c8be0bd3-c763-4c9e-8953-40ade86589b0 admin admin] Request method failure captured: Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept: application/json Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept-Encoding: gzip, deflate Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Connection: keep-alive Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Content-Length: 0 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Host: 10.222.0.26 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-System-Scope: None Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: User-Agent: python-novaclient Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Auth-Token: gAAAAABjOOArdJ5A6HTarrhkhG0--JYs_gvesEaQSrMgP59CPgKUGhKN72wraKbRuDG4rOZz5xy6SJ3hqFS8wKWOFFA_N1NrCsHO98pwKZOnr3GIJYo_oOaE5hUDojuKfNAZfgjzT2r-mMZER_hSNW3Ajhun8CvvvzUZAeUxRE_8IGxA3T9RF0I Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Id: None Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Name: None Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Identity-Status: Confirmed Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Is-Admin-Project: True Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Id: default Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Name: Default Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Name: admin Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Role: member,admin,reader Oct 02 00:49:47.783557 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Roles: member,admin,reader Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant: admin Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Name: admin Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User: admin Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Id: default Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Name: Default Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Name: admin Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: method: > Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: exception: Flavor 84 could not be found. Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: action_args: {'id': '84'} Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:47.785123 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:47.786016 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:47.787171 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-c8be0bd3-c763-4c9e-8953-40ade86589b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:47.788882 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-c8be0bd3-c763-4c9e-8953-40ade86589b0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011535 Oct 02 00:49:47.788882 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 2 00:49:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 02 00:49:49.033510 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-5114f73a-84d9-42bf-b8c7-4c724e128c0d admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:49.034516 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-5114f73a-84d9-42bf-b8c7-4c724e128c0d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 02 00:49:49.034909 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:49.597218 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-57e92629-3e2e-414b-80d8-7487772500ac admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:49.604129 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.wsgi [None req-57e92629-3e2e-414b-80d8-7487772500ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-57e92629-3e2e-414b-80d8-7487772500ac admin admin] Request method failure captured: Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept: application/json Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Accept-Encoding: gzip, deflate Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Connection: keep-alive Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Content-Length: 0 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Host: 10.222.0.26 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: Openstack-System-Scope: None Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: User-Agent: python-novaclient Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Auth-Token: gAAAAABjOOAsU6lxqaWSYYFPUPW7tbxg7tqYgx8w6-HJvM8fnA-rcl8zeC173PUf7pp7T9GOy-NqtjCJuJ8bCE5Gcsls0fK0vyhND6k4smvGGWl3n2wPwFjaFWTxQOSziPViliEfvyrpOaU-QVvFR5YGUjqv-qgZX6ILY6kOzzwC1amLxxYu_0I Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Id: None Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Domain-Name: None Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Identity-Status: Confirmed Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Is-Admin-Project: True Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Id: default Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Domain-Name: Default Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Project-Name: admin Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Role: member,admin,reader Oct 02 00:49:49.605711 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Roles: member,admin,reader Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant: admin Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-Tenant-Name: admin Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User: admin Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Id: default Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Domain-Name: Default Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: X-User-Name: admin Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: method: > Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: exception: Flavor 451 could not be found. Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: action_args: {'id': '451'} Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:49.607335 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:49.608270 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.609405 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-57e92629-3e2e-414b-80d8-7487772500ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:49.610477 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-57e92629-3e2e-414b-80d8-7487772500ac admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.431134 Oct 02 00:49:49.611426 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:49:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:49.617638 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-4f22d6fb-08b1-428b-b6a4-834715e943af admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:49.632853 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-4f22d6fb-08b1-428b-b6a4-834715e943af admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019463 Oct 02 00:49:49.633445 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:49.643102 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:49.658660 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019076 Oct 02 00:49:49.659218 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 2 00:49:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:49:49.669441 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-d6c117ed-65c7-40e7-80ed-948061f7a787 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:49.674707 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.wsgi [None req-d6c117ed-65c7-40e7-80ed-948061f7a787 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-d6c117ed-65c7-40e7-80ed-948061f7a787 admin admin] Request method failure captured: Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept: application/json Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Accept-Encoding: gzip, deflate Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Connection: keep-alive Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Content-Length: 0 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Host: 10.222.0.26 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-Api-Version: compute 2.92 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: Openstack-System-Scope: None Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: User-Agent: python-novaclient Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Auth-Token: gAAAAABjOOAsU6lxqaWSYYFPUPW7tbxg7tqYgx8w6-HJvM8fnA-rcl8zeC173PUf7pp7T9GOy-NqtjCJuJ8bCE5Gcsls0fK0vyhND6k4smvGGWl3n2wPwFjaFWTxQOSziPViliEfvyrpOaU-QVvFR5YGUjqv-qgZX6ILY6kOzzwC1amLxxYu_0I Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Id: None Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Domain-Name: None Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Identity-Status: Confirmed Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Is-Admin-Project: True Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Id: default Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Domain-Name: Default Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Project-Name: admin Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Role: member,admin,reader Oct 02 00:49:49.676215 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Roles: member,admin,reader Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6575bddc339f4fb18300234b880a2b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6575bddc339f4fb18300234b880a2b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant: admin Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Id: 6575bddc339f4fb18300234b880a2b64 Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-Tenant-Name: admin Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User: admin Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Id: default Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Domain-Name: Default Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Id: 1ae9e9d2d4e74a049733205286b14514 Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: X-User-Name: admin Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: method: > Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: exception: Flavor 451 could not be found. Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: action_args: {'id': '451'} Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:49:49.678439 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:49.679588 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: ERROR nova.api.openstack.wsgi Oct 02 00:49:49.680702 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-d6c117ed-65c7-40e7-80ed-948061f7a787 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:49:49.682014 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-d6c117ed-65c7-40e7-80ed-948061f7a787 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011775 Oct 02 00:49:49.682014 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:49:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:50.930895 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:50.931904 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 02 00:49:50.932313 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:51.485898 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-af4be632-fe2d-4c52-aa3f-d8a27b6bf497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:51.513318 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-af4be632-fe2d-4c52-aa3f-d8a27b6bf497 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.441319 Oct 02 00:49:51.513873 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 2 00:49:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:49:52.757805 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:52.758813 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 02 00:49:52.759210 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:53.317994 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-3017038c-ece4-40e4-95a8-f3b5d3362b65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:53.338749 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-3017038c-ece4-40e4-95a8-f3b5d3362b65 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.436258 Oct 02 00:49:53.339320 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 2 00:49:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:54.618119 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:54.619149 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 02 00:49:54.619550 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:55.161736 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-74b9d888-bea8-4685-bb2f-7ace72b0dfba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:55.183246 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-74b9d888-bea8-4685-bb2f-7ace72b0dfba admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.425586 Oct 02 00:49:55.183803 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 2 00:49:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:49:56.447477 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:56.448536 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 02 00:49:56.448931 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:56.992762 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-15b4acbc-a930-4897-bab1-699a990de08d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:49:57.014511 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-15b4acbc-a930-4897-bab1-699a990de08d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.425985 Oct 02 00:49:57.014968 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 2 00:49:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:49:58.275187 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:58.276182 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 02 00:49:58.276575 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:49:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:58.817980 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-32ff8f45-4092-42b7-9524-e26d05e12dfb admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:58.840321 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-32ff8f45-4092-42b7-9524-e26d05e12dfb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.425910 Oct 02 00:49:58.840806 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sun Oct 2 00:49:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:50:56.959719 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:56.960722 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-f2718d29-dbab-440e-bf85-ad7a2231c33e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 02 00:50:56.961174 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 2 00:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:50:56.972255 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:57.441688 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-7262d3e2-30e9-450d-952d-21fea45692cb admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:57.463108 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-7262d3e2-30e9-450d-952d-21fea45692cb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.495880 Oct 02 00:50:57.463643 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 2 00:50:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:50:57.485807 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_api:SELECT=14 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:57.490549 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-e58f2d95-578c-409a-ae5b-df9c98411a26 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:57.498289 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-e58f2d95-578c-409a-ae5b-df9c98411a26 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014190 Oct 02 00:50:57.498846 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Oct 2 00:50:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:50:57.511343 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-0b6b7a7f-89ab-4920-91da-4e4ff5c26db6 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:57.519853 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-0b6b7a7f-89ab-4920-91da-4e4ff5c26db6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012106 Oct 02 00:50:57.520424 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Oct 2 00:50:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:50:57.532336 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:57.540222 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011575 Oct 02 00:50:57.540763 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Oct 2 00:50:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:50:57.554376 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-e999c0f1-f41a-43e5-b93e-c497f43d6892 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:50:57.562003 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-e999c0f1-f41a-43e5-b93e-c497f43d6892 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012470 Oct 02 00:50:57.562559 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Oct 2 00:50:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:03.862095 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:03.863106 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 02 00:54:03.863493 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:04.013688 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=6 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:04.181658 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:04.186740 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:04.187216 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:04.187643 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:04.188351 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:04.188788 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:04.189226 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:04.221143 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-1cba0cc0-e533-4ffa-840b-5f09bf1dec6c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.208614 Oct 02 00:54:04.221710 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:54:04 2022] GET /compute/v2.1/os-services => generated 785 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:54:05.344704 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:05.345747 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 02 00:54:05.346145 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:05.544717 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:05.548335 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:05.548815 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:05.549271 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:05.549980 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:05.550454 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:05.550865 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:05.570602 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-e18a04d1-5ac4-4ad3-9898-bfaee60479a7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.082954 Oct 02 00:54:05.571162 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:54:05 2022] GET /compute/v2.1/os-services => generated 785 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:54:17.067890 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:17.068991 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 02 00:54:17.069393 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:17.224434 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_cell0:SELECT=4 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:17.225196 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_cell1:SELECT=4 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:17.225868 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG dbcounter [-] [105509] Writing DB stats nova_api:SELECT=8 {{(pid=105509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:17.275946 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:17.279557 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:17.280028 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:17.280456 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:17.281195 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:17.281641 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:17.282059 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:17.308029 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-94734e0f-f19e-4c7b-bb47-5424479dee9a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.087391 Oct 02 00:54:17.308598 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:54:17 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:54:18.397280 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG nova.api.openstack.wsgi [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] Calling method '>' {{(pid=105510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:18.398286 dv-cinder-master-3-smb devstack@n-api.service[105510]: INFO nova.api.openstack.requestlog [None req-004590cc-f9cb-4865-af8e-0080083471b3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 02 00:54:18.398679 dv-cinder-master-3-smb devstack@n-api.service[105510]: [pid: 105510|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 2 00:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:18.594625 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG nova.api.openstack.wsgi [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Calling method '>' {{(pid=105509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:18.598062 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:18.598531 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:18.598953 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:18.599653 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:18.600096 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:18.600505 dv-cinder-master-3-smb devstack@n-api.service[105509]: DEBUG oslo_concurrency.lockutils [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:18.622445 dv-cinder-master-3-smb devstack@n-api.service[105509]: INFO nova.api.openstack.requestlog [None req-4393cba9-09f5-485b-ace3-da61475a1782 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.081751 Oct 02 00:54:18.623008 dv-cinder-master-3-smb devstack@n-api.service[105509]: [pid: 105509|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 2 00:54:18 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:20.362027 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 02 00:55:20.363048 dv-cinder-master-3-smb devstack@n-api.service[105508]: Sun Oct 2 00:55:20 2022 - graceful shutdown triggered... Oct 02 00:55:20.363503 dv-cinder-master-3-smb devstack@n-api.service[105509]: Gracefully killing worker 1 (pid: 105509)... Oct 02 00:55:20.365472 dv-cinder-master-3-smb devstack@n-api.service[105510]: Gracefully killing worker 2 (pid: 105510)... Oct 02 00:55:20.493800 dv-cinder-master-3-smb devstack@n-api.service[105510]: DEBUG dbcounter [-] [105510] Writing DB stats nova_api:SELECT=4 {{(pid=105510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:21.366215 dv-cinder-master-3-smb devstack@n-api.service[105508]: worker 1 buried after 1 seconds Oct 02 00:55:21.366792 dv-cinder-master-3-smb devstack@n-api.service[105508]: worker 2 buried after 1 seconds Oct 02 00:55:21.366792 dv-cinder-master-3-smb devstack@n-api.service[105508]: goodbye to uWSGI. Oct 02 00:55:21.368010 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 02 00:55:21.368759 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 02 00:55:21.371529 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:55:21.382918 dv-cinder-master-3-smb devstack@n-api.service[120742]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:55:21 2022] *** Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: nodename: dv-cinder-master-3-smb Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: machine: x86_64 Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: clock source: unix Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: pcre jit disabled Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: detected number of CPU cores: 4 Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: current working directory: / Oct 02 00:55:21.385160 dv-cinder-master-3-smb devstack@n-api.service[120742]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: your processes number limit is 47680 Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: your memory page size is 4096 bytes Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: detected max file descriptor number: 2048 Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: lock engine: pthread robust mutexes Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: thunder lock: enabled Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:55:21.386683 dv-cinder-master-3-smb devstack@n-api.service[120742]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:55:21.428538 dv-cinder-master-3-smb devstack@n-api.service[120742]: Python main interpreter initialized at 0x55a2397659c0 Oct 02 00:55:21.428538 dv-cinder-master-3-smb devstack@n-api.service[120742]: python threads support enabled Oct 02 00:55:21.428538 dv-cinder-master-3-smb devstack@n-api.service[120742]: your server socket listen backlog is limited to 100 connections Oct 02 00:55:21.428538 dv-cinder-master-3-smb devstack@n-api.service[120742]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:55:21.429049 dv-cinder-master-3-smb devstack@n-api.service[120742]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:55:21.429049 dv-cinder-master-3-smb devstack@n-api.service[120742]: *** Operational MODE: preforking *** Oct 02 00:55:21.429342 dv-cinder-master-3-smb devstack@n-api.service[120742]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:55:21.429342 dv-cinder-master-3-smb devstack@n-api.service[120742]: spawned uWSGI master process (pid: 120742) Oct 02 00:55:21.429644 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:55:21.430428 dv-cinder-master-3-smb devstack@n-api.service[120742]: spawned uWSGI worker 1 (pid: 120759, cores: 1) Oct 02 00:55:21.434197 dv-cinder-master-3-smb devstack@n-api.service[120742]: spawned uWSGI worker 2 (pid: 120760, cores: 1) Oct 02 00:55:21.434197 dv-cinder-master-3-smb devstack@n-api.service[120742]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:55:22.107115 dv-cinder-master-3-smb devstack@n-api.service[120759]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:55:22.110249 dv-cinder-master-3-smb devstack@n-api.service[120760]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:55:23.313669 dv-cinder-master-3-smb devstack@n-api.service[120759]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:55:23.313669 dv-cinder-master-3-smb devstack@n-api.service[120759]: from cryptography.utils import int_from_bytes Oct 02 00:55:23.314796 dv-cinder-master-3-smb devstack@n-api.service[120759]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:55:23.314796 dv-cinder-master-3-smb devstack@n-api.service[120759]: from cryptography.utils import int_from_bytes Oct 02 00:55:23.320679 dv-cinder-master-3-smb devstack@n-api.service[120760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:55:23.320679 dv-cinder-master-3-smb devstack@n-api.service[120760]: from cryptography.utils import int_from_bytes Oct 02 00:55:23.321229 dv-cinder-master-3-smb devstack@n-api.service[120760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:55:23.321229 dv-cinder-master-3-smb devstack@n-api.service[120760]: from cryptography.utils import int_from_bytes Oct 02 00:55:25.838477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:55:25.839096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:55:25.839400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:55:25.839663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:55:25.839923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:55:25.840327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.840668 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.841020 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.841350 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.841690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.842012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.842331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.842664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.843000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.843268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.843600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.844092 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.844426 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.844747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.845093 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.845426 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.845740 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.846072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.846411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.846918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.847672 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.848018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.848416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.848789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.849135 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.849460 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.849794 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.850131 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.850472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.851405 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.851829 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.852159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.852488 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.852811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.853287 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.853603 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.853929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.854252 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.854590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.854914 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.855238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.855568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.855897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.856228 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.856539 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.856857 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.857203 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.857426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:55:25.857906 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.857986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:55:25.858074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.858162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.858235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:55:25.858529 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.858640 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:55:25.858716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.858798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:55:25.859007 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859193 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859832 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.859939 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860266 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.860924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863699 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.863941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864284 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864360 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864666 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.864988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865311 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865381 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865451 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865529 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.865609 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866025 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866188 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866188 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.866835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.867345 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.867515 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.867674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.867901 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.868239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.868396 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.868605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.868764 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.868918 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869748 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.869894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.870825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.871559 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.871718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.871879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873091 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873424 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873578 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.873901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.874050 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.874204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.874624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.875955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876115 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876708 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.876875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877075 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877226 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877371 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.877965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878417 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.878958 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879251 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879560 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.879859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.880760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.881645 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.881823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.883369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.883566 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.883747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.883902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884081 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884386 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884693 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.884876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.886553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.886914 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.887405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.887591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.887742 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.887890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888045 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.888824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889145 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.889862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890303 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890609 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.890903 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891054 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.891964 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.892105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.892247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.892400 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.892554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.892725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.893152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.893284 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.893403 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.893499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.893585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.893673 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.893767 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.893853 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.893951 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.893951 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.894115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.894286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.894470 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.894640 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894640 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894801 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.894901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.894988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.895079 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.895574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.895670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.895765 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.895865 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.895952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896036 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.896129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.896315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896414 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.896508 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.896679 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.896857 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.896967 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.897056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.897153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.897249 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.897341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.897433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.897528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.897691 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.898304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.898400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.898504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.898504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.898671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.898756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.898897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.898993 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.899118 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.899349 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.899441 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.899526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.899689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.899787 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.899873 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.899965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.900153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900251 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.900338 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.900515 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900599 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.900682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.900864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.900987 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.901130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.901130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.901316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.901412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.901504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.901590 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.901681 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.901767 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.901865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.901963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.902056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.902392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.902392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.902561 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.902646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.902739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.902826 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.902973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.903215 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.903308 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.903394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.903488 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.903587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.903689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.903782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.903876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.903968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.904063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.904145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.904288 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.904379 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.904464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.904556 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.904651 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.904736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.904827 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.904920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:55:25.905112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905222 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905668 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905890 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.905976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906157 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906249 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906341 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906510 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.906977 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907064 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907147 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907147 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907312 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.907808 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.908131 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.908371 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.908533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.908682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.908828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.909238 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.909391 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.909545 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.909736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.909736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910024 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910180 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910491 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910637 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.910930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.911090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.911248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.911401 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.911505 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.911694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.912015 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.912350 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914429 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914522 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914645 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.914957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915491 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915595 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.915987 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916198 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916701 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916797 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.916883 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917059 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917169 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917425 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917511 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.917931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918206 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918300 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918496 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918612 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.918952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919776 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.919878 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920757 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.920864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921112 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921434 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921750 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.921853 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.922815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923026 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923118 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.923942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924260 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924677 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.924892 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925061 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925244 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.925906 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.926158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.926324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.926471 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.926731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.926877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927034 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927175 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927483 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.927978 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928263 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928713 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.928885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.929003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.929982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930545 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930631 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930631 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.930980 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931160 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931244 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931327 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931610 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931781 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931873 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.931973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932060 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932263 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932586 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.932922 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933040 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933386 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.933911 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934007 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934556 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934667 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.934965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935271 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.935887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.936107 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.936246 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.936413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.936545 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.936733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937146 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937445 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937759 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.937976 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938385 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.938913 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939226 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.939935 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940083 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940711 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.940860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941505 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941654 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941803 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.941944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942093 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942399 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942698 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.942846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.943002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.943407 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.943553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.943727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.943863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.944015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.944015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.944299 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.944979 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945326 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945574 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.945998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946338 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946473 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946658 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.946985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947097 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947296 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947728 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.947943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948274 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948383 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948595 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948705 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.948917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949046 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949256 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949661 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.949978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.950194 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.950295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.950509 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.950799 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.950891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951232 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951448 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951769 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.951869 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952080 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952180 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.952824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953385 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953712 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.953864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954021 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954120 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954456 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.954961 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955053 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955429 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955571 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.955989 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956200 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956625 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.956956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957159 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957262 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957473 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957569 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.957879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.958806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959025 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959126 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959443 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959645 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959737 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.959958 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.960104 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.960837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.961089 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.961292 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.961467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.961667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.961796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962020 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962123 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962363 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962712 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.962811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963126 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963344 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963445 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963761 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.963963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964266 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964580 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.964897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965012 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965238 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.965969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966274 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.966917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967121 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967222 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.967852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968060 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968380 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968693 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.968810 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969028 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.969975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970293 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970607 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970716 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.970913 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971539 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.971852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972483 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972655 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972801 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.972960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973112 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973558 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.973854 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974240 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974783 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.974938 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975092 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975234 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975385 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.975958 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.976189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.976353 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.976553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.976695 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.976963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977133 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977231 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977810 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.977940 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.978893 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979061 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979210 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979524 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979838 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.979999 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.980960 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981101 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981428 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981862 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.981993 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.982175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.982292 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.982517 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.982661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.982856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983007 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.983988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984151 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984347 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.984993 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985102 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985427 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985645 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.985956 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986272 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986365 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986585 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.986899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987044 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987517 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987826 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.987989 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988434 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.988876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989047 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989355 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989656 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989806 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.989946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990558 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.990991 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991456 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.991934 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992382 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.992871 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993021 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993355 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993545 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993650 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.993956 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994195 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994289 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994520 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.994947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995243 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995551 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995768 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.995873 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996410 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996726 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.996878 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997485 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.997895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998036 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.998912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.999052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.999204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.999614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.999755 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:25.999907 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000064 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000236 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000602 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000810 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.000911 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001844 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.001980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002262 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002464 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.002868 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003186 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.003821 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004155 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004660 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.004989 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005567 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.005980 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.006205 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.006305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.006521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.006623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.006833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.007512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.007680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.007808 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008005 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008480 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008657 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.008760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009010 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009763 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.009977 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010608 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010702 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.010923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011030 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011236 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011672 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.011863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012006 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012171 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012649 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.012796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013010 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013120 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013429 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013644 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013792 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.013967 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014068 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014283 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014602 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.014938 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015232 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015382 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015552 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015665 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.015874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016004 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016192 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016299 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016505 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016599 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.016915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017299 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017593 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.017926 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018283 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018499 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.018894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.019843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020049 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020467 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.020774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021620 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021721 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.021944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.022047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.022253 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.022355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.022643 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.022814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023228 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023377 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.023795 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024021 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024114 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024354 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024455 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.024830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025034 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025213 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025844 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.025993 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026658 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.026973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.027194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.027294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.027508 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.027608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.027946 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028151 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028244 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028766 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.028868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029109 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029749 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.029843 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030064 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030415 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.030825 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031178 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.031792 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032014 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032121 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032423 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.032975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033391 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033608 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033701 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.033920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034562 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.034982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.035212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.035325 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.035529 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.035787 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.035948 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036457 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036778 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.036950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037441 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.037907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.038055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.038901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039054 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039757 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.039922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040734 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.040875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041555 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041733 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.041853 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042066 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042429 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042582 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.042893 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043200 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.043960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044272 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044408 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.044890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.045936 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046085 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046379 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046538 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.046976 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047121 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047441 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.047886 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048051 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048193 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048705 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.048860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.049932 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050262 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050480 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.050903 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.051116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.051218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.051864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052010 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052200 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052542 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.052972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.053151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.053298 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.053444 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.053596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.053782 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.054716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.054857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.055055 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.055223 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.055364 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.055504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.055687 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056469 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056749 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.056972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.057926 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.058915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.059016 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.059261 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.059430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.059598 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.059866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060224 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060377 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060543 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.060918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061682 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061827 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.061974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062118 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062266 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062424 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062567 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062717 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.062893 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063039 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063191 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063490 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063774 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.063924 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.064928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065099 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065364 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.065849 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066488 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066690 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.066783 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067078 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067730 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.067888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068046 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068696 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.068845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.069080 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.069248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.069953 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070133 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070325 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.070960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.071096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.071276 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.071580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.071672 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.071905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072007 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.072980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.073259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.073354 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.073590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.073797 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.073897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074243 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074564 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.074896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075120 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075750 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.075852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076251 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076729 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.076891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077050 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077498 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077606 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.077910 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078586 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078726 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.078960 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.079879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080078 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080179 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.080864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081023 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081149 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081331 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081426 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081741 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.081946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082049 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082253 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082567 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082662 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082872 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.082978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.083285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.083380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.083592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.083685 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.083905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084001 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084347 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084657 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.084869 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.085016 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.085807 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.085907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086120 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086211 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086433 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086755 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.086873 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087066 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087160 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.087800 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088365 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.088839 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089022 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089365 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.089922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090015 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.090887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091291 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091812 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.091914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092134 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092444 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092767 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.092921 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093372 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093522 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093826 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.093974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094125 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094583 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.094889 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095039 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095330 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095481 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095622 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.095852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096174 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096383 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096492 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.096816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097483 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.097802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098029 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098653 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.098965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099277 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099686 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.099924 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.100028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.100239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.100333 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.100548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.100683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101637 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101722 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101817 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.101947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102361 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102583 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102679 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.102912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103225 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103329 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103861 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.103963 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104192 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104294 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104621 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104851 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.104972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105304 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105510 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.105922 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106113 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.106841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107058 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107154 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107467 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107667 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.107977 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108078 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.108891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109117 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109323 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.109930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110259 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.110945 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111055 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111280 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111609 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.111910 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.112016 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.112216 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.112310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.112464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:55:26.112555 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.112812 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.113146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.113478 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.113811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.114677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.114677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.114879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.115191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.115502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.115824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.116144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.116497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.116804 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.117336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.117657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.117972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.118288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.118602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.118914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.119226 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.119557 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.119884 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.120189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.120515 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.120833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.121182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.121499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.121815 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.126879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.127773 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.127773 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.127773 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.128186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.128288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.128760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.128881 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.129217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:55:26.129471 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:55:26.176078 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO dbcounter [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Registered counter for database nova_api Oct 02 00:55:26.196840 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO dbcounter [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Registered counter for database nova_api Oct 02 00:55:26.200025 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_db.sqlalchemy.engines [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.207364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writer thread running {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.218228 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_db.sqlalchemy.engines [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.224784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writer thread running {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.265527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.context [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=120759) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:55:26.269636 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.270124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.271707 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.272433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.273489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.275716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.277843 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO dbcounter [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Registered counter for database nova_cell0 Oct 02 00:55:26.281996 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO dbcounter [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Registered counter for database nova_cell1 Oct 02 00:55:26.282657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.context [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=120760) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:55:26.287292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.287784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.289057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_db.sqlalchemy.engines [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.289423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.290423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.291179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.291536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_db.sqlalchemy.engines [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.293549 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.295626 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO dbcounter [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Registered counter for database nova_cell0 Oct 02 00:55:26.296234 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writer thread running {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.299750 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO dbcounter [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Registered counter for database nova_cell1 Oct 02 00:55:26.307633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_db.sqlalchemy.engines [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.310297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_db.sqlalchemy.engines [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.314986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writer thread running {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.317519 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writer thread running {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.439743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writer thread running {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.451051 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO dbcounter [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Registered counter for database nova_cell0 Oct 02 00:55:26.460511 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_db.sqlalchemy.engines [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.465589 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writer thread running {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.476708 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO dbcounter [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Registered counter for database nova_cell0 Oct 02 00:55:26.484297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_db.sqlalchemy.engines [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:55:26.489357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writer thread running {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:55:26.801839 dv-cinder-master-3-smb devstack@n-api.service[120759]: WARNING keystonemiddleware.auth_token [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:55:26.809994 dv-cinder-master-3-smb devstack@n-api.service[120759]: WARNING keystonemiddleware.auth_token [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:55:26.820246 dv-cinder-master-3-smb devstack@n-api.service[120760]: WARNING keystonemiddleware.auth_token [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:55:26.828045 dv-cinder-master-3-smb devstack@n-api.service[120760]: WARNING keystonemiddleware.auth_token [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:55:27.172351 dv-cinder-master-3-smb devstack@n-api.service[120759]: WARNING keystonemiddleware.auth_token [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:55:27.179085 dv-cinder-master-3-smb devstack@n-api.service[120759]: WARNING keystonemiddleware.auth_token [None req-144ec727-8aea-4ff2-972e-06c623f7a329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:55:27.181250 dv-cinder-master-3-smb devstack@n-api.service[120760]: WARNING keystonemiddleware.auth_token [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:55:27.184481 dv-cinder-master-3-smb devstack@n-api.service[120759]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2397659c0 pid: 120759 (default app) Oct 02 00:55:27.187269 dv-cinder-master-3-smb devstack@n-api.service[120760]: WARNING keystonemiddleware.auth_token [None req-d470464b-0aba-4bb6-9185-03c11c82706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:55:27.192573 dv-cinder-master-3-smb devstack@n-api.service[120760]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2397659c0 pid: 120760 (default app) Oct 02 00:56:04.826904 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.827779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.828967 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.829777 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:05.960057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-53d08c5f-7704-4b1e-b781-9e919ffe114a tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Action: 'create', calling method: .version_select at 0x7feb058ee4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1735640173"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:06.865571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.867761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.868722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.869747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:08.066545 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-78090b83-89ed-43c1-b78a-0f59bd55a9a3 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Action: 'create', calling method: .version_select at 0x7feb058ef4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-284418155", "metadata": {"Type": "work"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-78090b83-89ed-43c1-b78a-0f59bd55a9a3 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 121 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:56:08.074970 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-284418155", "metadata": {"Type": "work"}}} Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 00:56:08.077980 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-284418155', 'metadata': {'Type': 'work'}}}} Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi '#$%' Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:08.079949 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:56:08.083739 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:56:08.087653 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:56:08.087653 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.087653 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-78090b83-89ed-43c1-b78a-0f59bd55a9a3 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:08.087653 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-78090b83-89ed-43c1-b78a-0f59bd55a9a3 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.227647 Oct 02 00:56:08.087653 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 2 00:56:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 00:56:08.090749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e1a86f8b-5a75-4463-84b5-26e52327d472 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb058efe50>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:08.469052 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-53d08c5f-7704-4b1e-b781-9e919ffe114a tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.647173 Oct 02 00:56:08.484795 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Sun Oct 2 00:56:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3651 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 00:56:08.497870 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5a971f74-1c67-4b2e-9ce4-c8db75c95aab tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Action: 'create', calling method: .version_select at 0x7feb057c2310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-845717190", "metadata": {"Type": "work"}}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5a971f74-1c67-4b2e-9ce4-c8db75c95aab tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 119 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:56:08.547971 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-845717190", "metadata": {"Type": "work"}}} Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: Oct 02 00:56:08.551083 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-845717190', 'metadata': {'Type': 'work'}}}} Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi '0' Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:08.554514 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:56:08.561091 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:56:08.567078 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:56:08.567078 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.567078 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5a971f74-1c67-4b2e-9ce4-c8db75c95aab tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:08.567078 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5a971f74-1c67-4b2e-9ce4-c8db75c95aab tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.084939 Oct 02 00:56:08.570937 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 2 00:56:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:56:08.617856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aa9005e1-21c3-4d55-a86f-7f47ce9bc646 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb057d4e50>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:08.900429 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e1a86f8b-5a75-4463-84b5-26e52327d472 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9d8f7bf1-7949-4e69-a67c-198a342eb8f8" status: 200 len: 351 microversion: 2.1 time: 0.816216 Oct 02 00:56:08.911696 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:08 2022] GET /compute/v2.1/os-volumes/9d8f7bf1-7949-4e69-a67c-198a342eb8f8 => generated 351 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:08.916269 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-060b28a8-08a0-47ec-8d2b-9c32fd423b63 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Action: 'create', calling method: .version_select at 0x7feb0577b940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878954030", "metadata": {"Type": "work"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-060b28a8-08a0-47ec-8d2b-9c32fd423b63 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 118 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:56:08.928631 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878954030", "metadata": {"Type": "work"}}} Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 00:56:08.930497 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-878954030', 'metadata': {'Type': 'work'}}}} Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi '' Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:08.931337 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:56:08.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:56:08.935308 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:56:08.935308 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:08.935308 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-060b28a8-08a0-47ec-8d2b-9c32fd423b63 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:08.936236 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-060b28a8-08a0-47ec-8d2b-9c32fd423b63 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032385 Oct 02 00:56:08.938971 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 3/5] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 2 00:56:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:56:08.950586 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e02d4127-9399-48a9-a490-ca17fcf8501b tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Calling method '.version_select at 0x7feb0578ce50>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:09.006140 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aa9005e1-21c3-4d55-a86f-7f47ce9bc646 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 200 len: 345 microversion: 2.1 time: 0.426947 Oct 02 00:56:09.013311 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:08 2022] GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 345 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:09.052376 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-e02d4127-9399-48a9-a490-ca17fcf8501b tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] HTTP exception thrown: Volume tempest-invalid-2105352753 could not be found. Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e02d4127-9399-48a9-a490-ca17fcf8501b tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2105352753 HTTP/1.1 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:56:09.057439 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Volume tempest-invalid-2105352753 could not be found. Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'tempest-invalid-2105352753'} Oct 02 00:56:09.059779 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2105352753 could not be found. (HTTP 404) (Request-ID: req-19ded3e7-ce0f-4e4b-90ca-db7edba39e31) Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.061513 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:09.064495 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2105352753 could not be found. Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:09.076263 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2105352753 could not be found. Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2105352753 could not be found. Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e02d4127-9399-48a9-a490-ca17fcf8501b tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 404 to user: Volume tempest-invalid-2105352753 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e02d4127-9399-48a9-a490-ca17fcf8501b tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2105352753" status: 404 len: 99 microversion: 2.1 time: 0.117087 Oct 02 00:56:09.083443 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Oct 2 00:56:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2105352753 => generated 99 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 00:56:09.085443 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0db62c49-da25-4b70-a8d5-d6b42cbec567 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004494 Oct 02 00:56:09.085443 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Oct 2 00:56:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 00:56:09.089848 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5fa1a7c4-3010-4ee7-92f6-3bd10cbf47f0 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004718 Oct 02 00:56:09.090398 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1137 bytes} [Sun Oct 2 00:56:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 02 00:56:09.105327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-40295c8c-5caa-4778-92ee-3809d3aca918 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Calling method '.version_select at 0x7feb057d4ee0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:09.173503 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-40295c8c-5caa-4778-92ee-3809d3aca918 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] HTTP exception thrown: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-40295c8c-5caa-4778-92ee-3809d3aca918 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/os-volumes/fbdf9d97-e623-4f02-b30e-9106ce2ed20a HTTP/1.1 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:56:09.179238 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'fbdf9d97-e623-4f02-b30e-9106ce2ed20a'} Oct 02 00:56:09.180933 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. (HTTP 404) (Request-ID: req-23cbdf5e-a002-489c-bb20-b5ed7b6eba45) Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.182043 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:09.183477 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:56:09.184818 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-40295c8c-5caa-4778-92ee-3809d3aca918 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 404 to user: Volume fbdf9d97-e623-4f02-b30e-9106ce2ed20a could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:09.186182 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-40295c8c-5caa-4778-92ee-3809d3aca918 tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/fbdf9d97-e623-4f02-b30e-9106ce2ed20a" status: 404 len: 109 microversion: 2.1 time: 0.085055 Oct 02 00:56:09.189056 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 00:56:09 2022] DELETE /compute/v2.1/os-volumes/fbdf9d97-e623-4f02-b30e-9106ce2ed20a => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:09.201176 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6df8e394-53bd-4494-8b54-1d8227cb5dfa tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Calling method '.version_select at 0x7feb056e15e0>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:09.412924 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-6df8e394-53bd-4494-8b54-1d8227cb5dfa tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] HTTP exception thrown: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6df8e394-53bd-4494-8b54-1d8227cb5dfa tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Request method failure captured: Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/os-volumes/612760e0-182d-4371-a6f6-f3763f2358f5 HTTP/1.1 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOGm81gBeHQtN1ybgXyo_IiFD0jSH9Pk-JhDHqdehBPlDmngSDzsx1JTJHurYCO5HlHo45CuldGQfbZmNqV4sX572pPPRgiGFjb-an2ZkpsJcAA149rCB6aflBTQUrkhdjrXrJFuToJveYJlZdzm35Pgw_6o-jHGosTJ7_6CyovXutU Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:56:09.416067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33810d0b44214f3b8e8edb143f94ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 33810d0b44214f3b8e8edb143f94ee66 Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesNegativeTest-2127420314 Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: e35159bbdd4d4899a3b6c7ad09b0ee37 Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesNegativeTest-2127420314-project Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '612760e0-182d-4371-a6f6-f3763f2358f5'} Oct 02 00:56:09.417826 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. (HTTP 404) (Request-ID: req-360e0607-0d39-4349-9953-698c13470f7d) Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.419127 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:09.420859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:56:09.422833 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. Oct 02 00:56:09.424881 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:09.430274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6df8e394-53bd-4494-8b54-1d8227cb5dfa tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] Returning 404 to user: Volume 612760e0-182d-4371-a6f6-f3763f2358f5 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:09.430274 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6df8e394-53bd-4494-8b54-1d8227cb5dfa tempest-VolumesNegativeTest-2127420314 tempest-VolumesNegativeTest-2127420314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/612760e0-182d-4371-a6f6-f3763f2358f5" status: 404 len: 109 microversion: 2.1 time: 0.234702 Oct 02 00:56:09.430274 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:09 2022] GET /compute/v2.1/os-volumes/612760e0-182d-4371-a6f6-f3763f2358f5 => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:10.024615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ddbe1e75-6412-4ac2-afe7-d7fd5a7821a0 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb06120af0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:10.134202 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ddbe1e75-6412-4ac2-afe7-d7fd5a7821a0 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 200 len: 346 microversion: 2.1 time: 0.117416 Oct 02 00:56:10.134969 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:10 2022] GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:56:10.151277 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-554f5a1f-1c69-4efd-9819-7572622a9a41 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Action: 'create', calling method: .version_select at 0x7feb0578ce50>, body: {"snapshot": {"volume_id": "1b212100-d025-4465-9a3a-400412bee2df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1501220879"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:10.801118 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-554f5a1f-1c69-4efd-9819-7572622a9a41 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.653101 Oct 02 00:56:10.811244 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 7/13] 10.222.0.26 () {60 vars in 1162 bytes} [Sun Oct 2 00:56:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:10.819966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3f713522-b57e-42e4-84d1-e9a55da09238 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb057d41f0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:10.905893 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3f713522-b57e-42e4-84d1-e9a55da09238 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64" status: 200 len: 287 microversion: 2.1 time: 0.093566 Oct 02 00:56:10.906650 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 2 00:56:10 2022] GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:56:10.925288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-112af0e1-2479-41a0-ba4e-d14f8fc8aa8f tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb056eb160>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:10.986355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-64a94809-5c06-4346-85c8-e35c5c9654d9 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb05754700>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:11.061050 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-112af0e1-2479-41a0-ba4e-d14f8fc8aa8f tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.141857 Oct 02 00:56:11.062335 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Oct 2 00:56:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:11.075058 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9b36a495-1211-46b4-8763-2cbf10b59c3f tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb056ebc10>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:11.134904 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-64a94809-5c06-4346-85c8-e35c5c9654d9 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d9333924-9c4d-4c16-a1f0-54148ac93498" status: 200 len: 350 microversion: 2.1 time: 0.154113 Oct 02 00:56:11.135494 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:10 2022] GET /compute/v2.1/os-volumes/d9333924-9c4d-4c16-a1f0-54148ac93498 => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:56:11.243872 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9b36a495-1211-46b4-8763-2cbf10b59c3f tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64" status: 200 len: 288 microversion: 2.1 time: 0.172503 Oct 02 00:56:11.257070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1244d35d-c9f6-4c4f-a042-b9259412ac8a tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb05754e50>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:11.257458 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 2 00:56:11 2022] GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 => generated 288 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:11.466860 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1244d35d-c9f6-4c4f-a042-b9259412ac8a tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64" status: 202 len: 0 microversion: 2.1 time: 0.213766 Oct 02 00:56:11.476363 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1254 bytes} [Sun Oct 2 00:56:11 2022] DELETE /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:56:11.479893 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-89ed9be2-7825-4460-a596-36830fd21cd3 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb056eb430>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:11.590252 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-89ed9be2-7825-4460-a596-36830fd21cd3 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64" status: 200 len: 287 microversion: 2.1 time: 0.115142 Oct 02 00:56:11.591444 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 2 00:56:11 2022] GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:12.605573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3adfcf31-ac84-4502-85da-a2d80108323d tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb05754940>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:12.663099 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-3adfcf31-ac84-4502-85da-a2d80108323d tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] HTTP exception thrown: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3adfcf31-ac84-4502-85da-a2d80108323d tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Request method failure captured: Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 HTTP/1.1 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOGkWJvCk38HDlcjHUESX_09T-oYmCYV58smnPCTWIQ6skPhPK9BY47oxaTqLI0fRwt0mdyXnJAJkwc1Myhyo56PF3KLjH5rB-lA6tb_musoREKQS8e9s5qtVoBBzvAp4JnMHmmFdAHih2QhaAL_8uQtamBUYXqI-x8Up6-VB-t52I8 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:56:12.668573 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5875cb30504d3390f6499ec184022c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 0c5772cc673e480fbec2cc6a87177203 Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '506bc7d2-3697-4baa-98bb-cfcae21a0a64'} Oct 02 00:56:12.671018 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. (HTTP 404) (Request-ID: req-2c157af7-8d3c-4b1d-8394-e04b013e24f7) Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.673409 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:12.675303 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 02 00:56:12.677345 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. Oct 02 00:56:12.679298 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:12.682088 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3adfcf31-ac84-4502-85da-a2d80108323d tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Returning 404 to user: Snapshot 506bc7d2-3697-4baa-98bb-cfcae21a0a64 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:12.683641 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3adfcf31-ac84-4502-85da-a2d80108323d tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64" status: 404 len: 111 microversion: 2.1 time: 0.082909 Oct 02 00:56:12.684848 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 2 00:56:12 2022] GET /compute/v2.1/os-snapshots/506bc7d2-3697-4baa-98bb-cfcae21a0a64 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:12.708809 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2cbc24e9-a1ab-4d2e-bca0-648a5395baad tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb056e1e50>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:12.930058 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2cbc24e9-a1ab-4d2e-bca0-648a5395baad tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 202 len: 0 microversion: 2.1 time: 0.237595 Oct 02 00:56:12.933088 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 00:56:12 2022] DELETE /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:56:12.954402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2b6386bd-b428-4061-b594-95e73372db50 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb057d4ca0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.035024 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f83a0c4f-a00f-4fb7-b68d-ab38d1bda9cf tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb056ebee0>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.117236 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2b6386bd-b428-4061-b594-95e73372db50 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 200 len: 345 microversion: 2.1 time: 0.175593 Oct 02 00:56:13.133632 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:12 2022] GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:13.170971 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f83a0c4f-a00f-4fb7-b68d-ab38d1bda9cf tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/fcc1e1f5-b236-4ec8-81c9-4b645aeb56c2" status: 200 len: 351 microversion: 2.1 time: 0.145756 Oct 02 00:56:13.173149 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/os-volumes/fcc1e1f5-b236-4ec8-81c9-4b645aeb56c2 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:13.194601 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b0a97c3b-d59b-4237-bef2-b4cf7dcd7ca7 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb057d49d0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.425235 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b0a97c3b-d59b-4237-bef2-b4cf7dcd7ca7 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.235224 Oct 02 00:56:13.427218 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:13.445625 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-03fd20c8-cfdf-47bd-b33e-2bc71db898fc tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb056eb9d0>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.747147 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-03fd20c8-cfdf-47bd-b33e-2bc71db898fc tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.307950 Oct 02 00:56:13.749016 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1149 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:13.764069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6938f33e-dfe2-4bf8-85b7-041216d88d01 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb06120820>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.940174 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6938f33e-dfe2-4bf8-85b7-041216d88d01 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179444 Oct 02 00:56:13.951918 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:13.956413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a754544e-c601-45c9-889d-bf1a9af7e711 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb056e1790>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.146622 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-48fdb49a-9b5b-44b3-8f64-eae59961adc1 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb056f03a0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.154267 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a754544e-c601-45c9-889d-bf1a9af7e711 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.201793 Oct 02 00:56:14.155225 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1167 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:14.170718 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-18a55af8-c5ce-4573-8e85-6b9faef40169 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb0578ca60>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.230830 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-48fdb49a-9b5b-44b3-8f64-eae59961adc1 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] HTTP exception thrown: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-48fdb49a-9b5b-44b3-8f64-eae59961adc1 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Request method failure captured: Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df HTTP/1.1 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOGkWJvCk38HDlcjHUESX_09T-oYmCYV58smnPCTWIQ6skPhPK9BY47oxaTqLI0fRwt0mdyXnJAJkwc1Myhyo56PF3KLjH5rB-lA6tb_musoREKQS8e9s5qtVoBBzvAp4JnMHmmFdAHih2QhaAL_8uQtamBUYXqI-x8Up6-VB-t52I8 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:56:14.236120 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5875cb30504d3390f6499ec184022c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 0c5772cc673e480fbec2cc6a87177203 Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '1b212100-d025-4465-9a3a-400412bee2df'} Oct 02 00:56:14.238132 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. (HTTP 404) (Request-ID: req-f2e5152e-c99c-440a-ba8e-c148b39a0c43) Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.238888 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:14.240300 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:56:14.244718 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.248728 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.255178 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-48fdb49a-9b5b-44b3-8f64-eae59961adc1 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Returning 404 to user: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:14.259887 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-48fdb49a-9b5b-44b3-8f64-eae59961adc1 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 404 len: 109 microversion: 2.1 time: 0.123642 Oct 02 00:56:14.261457 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 00:56:14.276534 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f07be331-a7f3-49bf-a59f-6e2d80c99252 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb0578f700>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.337001 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-f07be331-a7f3-49bf-a59f-6e2d80c99252 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] HTTP exception thrown: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f07be331-a7f3-49bf-a59f-6e2d80c99252 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Request method failure captured: Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df HTTP/1.1 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOGkWJvCk38HDlcjHUESX_09T-oYmCYV58smnPCTWIQ6skPhPK9BY47oxaTqLI0fRwt0mdyXnJAJkwc1Myhyo56PF3KLjH5rB-lA6tb_musoREKQS8e9s5qtVoBBzvAp4JnMHmmFdAHih2QhaAL_8uQtamBUYXqI-x8Up6-VB-t52I8 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:56:14.342038 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5875cb30504d3390f6499ec184022c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 0c5772cc673e480fbec2cc6a87177203 Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '1b212100-d025-4465-9a3a-400412bee2df'} Oct 02 00:56:14.344413 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. (HTTP 404) (Request-ID: req-916df125-09b9-4e68-ab8d-ca20d1ed55b4) Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.345935 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:56:14.347782 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:56:14.352922 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f07be331-a7f3-49bf-a59f-6e2d80c99252 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Returning 404 to user: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:14.358680 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f07be331-a7f3-49bf-a59f-6e2d80c99252 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 404 len: 109 microversion: 2.1 time: 0.084243 Oct 02 00:56:14.369942 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-18a55af8-c5ce-4573-8e85-6b9faef40169 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.202310 Oct 02 00:56:14.373949 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1170 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:56:14.377514 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 00:56:14 2022] DELETE /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:14.396698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-320675ae-632a-437e-9265-ea814c537b76 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Calling method '.version_select at 0x7feb0577b940>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.404486 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7a0cc877-2f28-432c-b345-210e19db2443 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb0578fc10>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.531484 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-320675ae-632a-437e-9265-ea814c537b76 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] HTTP exception thrown: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-320675ae-632a-437e-9265-ea814c537b76 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Request method failure captured: Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df HTTP/1.1 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOGkWJvCk38HDlcjHUESX_09T-oYmCYV58smnPCTWIQ6skPhPK9BY47oxaTqLI0fRwt0mdyXnJAJkwc1Myhyo56PF3KLjH5rB-lA6tb_musoREKQS8e9s5qtVoBBzvAp4JnMHmmFdAHih2QhaAL_8uQtamBUYXqI-x8Up6-VB-t52I8 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:56:14.546067 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5875cb30504d3390f6499ec184022c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5875cb30504d3390f6499ec184022c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: ae5875cb30504d3390f6499ec184022c Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-126607898 Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 0c5772cc673e480fbec2cc6a87177203 Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesSnapshotsTestJSON-126607898-project Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '1b212100-d025-4465-9a3a-400412bee2df'} Oct 02 00:56:14.548758 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. (HTTP 404) (Request-ID: req-c2dadb14-7eb6-469d-8cc3-085f6a84f4d7) Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.550052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:56:14.552457 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:56:14.557812 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. Oct 02 00:56:14.563179 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:56:14.571186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-320675ae-632a-437e-9265-ea814c537b76 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] Returning 404 to user: Volume 1b212100-d025-4465-9a3a-400412bee2df could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:14.575431 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-320675ae-632a-437e-9265-ea814c537b76 tempest-VolumesSnapshotsTestJSON-126607898 tempest-VolumesSnapshotsTestJSON-126607898-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df" status: 404 len: 109 microversion: 2.1 time: 0.193109 Oct 02 00:56:14.577820 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/os-volumes/1b212100-d025-4465-9a3a-400412bee2df => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:14.742968 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7a0cc877-2f28-432c-b345-210e19db2443 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.351454 Oct 02 00:56:14.745470 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:14.762671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f78bf06e-b922-4001-851d-6ece1cb48c69 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb0577b940>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:15.076137 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f78bf06e-b922-4001-851d-6ece1cb48c69 tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.319141 Oct 02 00:56:15.076877 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1188 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:15.092974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7458cd61-a7b2-49c1-92b1-94091163c19d tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] Calling method '.version_select at 0x7feb05754790>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:15.347640 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7458cd61-a7b2-49c1-92b1-94091163c19d tempest-VolumesTestJSON-1278540680 tempest-VolumesTestJSON-1278540680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.260062 Oct 02 00:56:15.350081 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Oct 2 00:56:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:25.504782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1880022036", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "4a6c688f-acda-4823-8d65-412190047138"}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:25.807363 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] validate_networks() for [('4a6c688f-acda-4823-8d65-412190047138', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:27.031341 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f7762838-baa5-4491-9339-65a022f282b7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: .version_select at 0x7feb056f0670>, body: {"keypair": {"name": "tempest-keypair-1715284996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdKC7RbdxOT9bSfniO+lpyYLY2RkPQOLY3jEJ+jn2ZfLOlSuQyNawjKGAZo3kp0kkTf56JtxXPea/cMg9D/OPVc84PD7kvpV4KkAR2xTYlLbrmtmFWOUCNVgndvLDlkhQ=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:27.121182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f7762838-baa5-4491-9339-65a022f282b7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for project 346545279d0943359a5d495b9dc7f498. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:27.136892 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f7762838-baa5-4491-9339-65a022f282b7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for user c21c29da391b4d78a063dbe50057b6eb and project 346545279d0943359a5d495b9dc7f498. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:27.297055 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f7762838-baa5-4491-9339-65a022f282b7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.978910 Oct 02 00:56:27.303907 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 18/35] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Oct 2 00:56:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 998 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 00:56:28.346632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8fa8c4ff-1e41-4720-84fe-9019961abbf6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: .version_select at 0x7feb056bba60>, body: {"keypair": {"name": "tempest-keypair-1861427240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPEZzzEdflupJee+FNkOI3xbAlKdzW02bKTHhgtoiiWFTDeXLtPVJ/eYj4MibM+qN7u8kbpiCJvFZxhyED52nEH++rFjHSRRRV0+vhJPlBybk6n8f9S3c4IIqDT/lacw=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:28.411563 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-8fa8c4ff-1e41-4720-84fe-9019961abbf6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:28.419286 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-8fa8c4ff-1e41-4720-84fe-9019961abbf6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for user 1f392d3cac0149b09d4f83e83a930298 and project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:28.476114 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8fa8c4ff-1e41-4720-84fe-9019961abbf6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.006923 Oct 02 00:56:28.477747 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 19/36] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 00:56:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:29.448209 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:29.448846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:29.448927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:29.449367 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:29.449782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:29.484582 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:29.486369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:29.488678 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:29.492017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:29.492772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:29.493819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:29.567897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1657577093", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:29.574231 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Getting quotas for project f9c28bdfe12d4a6a956d0f52696c3721. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:29.590905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Getting quotas for user 4a82acab3a5b4808b62a72adf3c61d48 and project f9c28bdfe12d4a6a956d0f52696c3721. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:29.627042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:29.633473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:29.755879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] validate_networks() for [('2d2b0268-d76d-48d0-9319-e95162e09f4e', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:29.891910 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2c5c8655-d313-4d04-8a9b-8bd76033a810 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.076799 Oct 02 00:56:29.915457 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 5101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:29.937076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bca9281a-7329-400a-bfe9-77c0fb60e075 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:29.940038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bca9281a-7329-400a-bfe9-77c0fb60e075 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:30.344402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bca9281a-7329-400a-bfe9-77c0fb60e075 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:30.374765 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bca9281a-7329-400a-bfe9-77c0fb60e075 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1215 microversion: 2.1 time: 0.455114 Oct 02 00:56:30.375371 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:29 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:31.400689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d9b4b7a1-a018-425b-9ddf-8e2e79a6b14d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:31.401473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d9b4b7a1-a018-425b-9ddf-8e2e79a6b14d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:32.279704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d9b4b7a1-a018-425b-9ddf-8e2e79a6b14d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:32.287912 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d9b4b7a1-a018-425b-9ddf-8e2e79a6b14d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1215 microversion: 2.1 time: 0.892375 Oct 02 00:56:32.303823 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:31 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1215 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:32.610852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1717821749", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8867ab9-a90e-4dd4-a534-b8cbedc8860c"}], "security_groups": [{"name": "tempest-securitygroup--1232232620"}], "key_name": "tempest-keypair-1715284996", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:33.157459 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] validate_networks() for [('a8867ab9-a90e-4dd4-a534-b8cbedc8860c', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:33.482788 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:33.484220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:33.485022 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:33.485645 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:33.486349 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:33.512648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:33.513208 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:33.513655 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:33.514476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:33.515290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:33.515905 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:33.549096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:33.558835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for user 5ff136440ace420997181fbf11999496 and project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:33.578756 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:33.583530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:33.709068 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-782bbdff-3724-4d5f-90a0-4d9fcf7dd9c9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.454881 Oct 02 00:56:33.709550 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 4457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 00:56:33.715296 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:33.716389 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:33.732073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:33.732578 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:33.733174 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:33.733920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:33.734401 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:33.734830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.262275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:34.319736 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8cfd4f42-4335-4245-a19f-882fbe9fbd46 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1267 microversion: 2.1 time: 0.603812 Oct 02 00:56:34.320621 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:33 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1267 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:34.354623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5b4f3af0-a24c-4733-918b-06ecb4b69f57 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:34.362041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5b4f3af0-a24c-4733-918b-06ecb4b69f57 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:34.849402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:34.849937 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:34.850535 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:34.851243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:34.851953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:34.880598 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.885621 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.890161 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.891856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.892565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.895614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.964986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for project 346545279d0943359a5d495b9dc7f498. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:34.990716 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for user c21c29da391b4d78a063dbe50057b6eb and project 346545279d0943359a5d495b9dc7f498. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:35.039936 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:35.045523 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:35.204446 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9720b2aa-b45f-48a8-83fe-bf0150d2418c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.597671 Oct 02 00:56:35.225186 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 21/42] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Oct 2 00:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 00:56:35.241062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:35.246246 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:35.365604 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5b4f3af0-a24c-4733-918b-06ecb4b69f57 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:35.413662 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5b4f3af0-a24c-4733-918b-06ecb4b69f57 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1222 microversion: 2.1 time: 1.068267 Oct 02 00:56:35.445245 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:34 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1222 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:35.457234 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:35.460387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:35.489384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.490124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.490557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.492568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.495264 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.496493 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.950894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:35.984126 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:35.996161 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:36.012413 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f1f5fa6f-efbe-4275-b557-a39020f67c60 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1282 microversion: 2.20 time: 0.780114 Oct 02 00:56:36.016794 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:35 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1282 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:36.044717 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-32207634", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:36.240911 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] validate_networks() for [('2d2b0268-d76d-48d0-9319-e95162e09f4e', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:36.736663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:36.767632 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-286dc271-16ea-420e-bea1-ebe98b694550 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1273 microversion: 2.1 time: 1.311939 Oct 02 00:56:36.778145 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:35 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1273 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:37.059035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:37.060085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:37.143962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.145055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.145547 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:37.146464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.147071 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.164402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:38.011889 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:38.035885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:38.052517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:38.062579 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b5d54b6a-906e-439c-acde-2ec56e92214b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1286 microversion: 2.20 time: 1.009008 Oct 02 00:56:38.063865 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:37 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1286 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:38.076503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:38.077541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:38.108970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.112504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.115045 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:38.115941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.118081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.118642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.687343 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:40.702714 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0732289d-cf6e-4c62-9c73-edf2b7fd3e83 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 2.637527 Oct 02 00:56:40.703299 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 25/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:38 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:40.746516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:40.750743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:40.781394 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.790178 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.791079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.792016 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.794317 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.797154 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:41.383645 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:41.395943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:41.399189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:41.401378 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e9161fed-1262-4378-9f59-d8f3ad471c7b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1340 microversion: 2.20 time: 0.671511 Oct 02 00:56:41.417666 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 26/48] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:40 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1340 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:41.746323 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:41.749689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:41.765084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.766885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.767575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:41.769566 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.772848 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.773620 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.886131 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:42.886791 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:42.887051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:42.887763 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:42.888227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:42.918933 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:42.920979 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:42.921538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.922360 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:42.922844 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:42.923308 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.965455 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:42.970513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for user 5ff136440ace420997181fbf11999496 and project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:42.985857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:42.988762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:43.074855 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2f702663-b5aa-4f30-a4b7-cd652d29227f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.054860 Oct 02 00:56:43.076168 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 23/49] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 7059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:43.082334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1180775604", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08544471-7a68-4aa2-a2bf-b9cbb7450fd5"}], "security_groups": [{"name": "tempest-securitygroup--452263976"}], "key_name": "tempest-keypair-1861427240", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:43.533992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:43.793367 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:43.814779 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-714e3bcb-d368-4d7c-96ec-e51c83300f6b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 2.087111 Oct 02 00:56:43.818923 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 27/50] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:41 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:43.860108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:43.896909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:43.927105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.930069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.932600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:43.933881 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.944298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.945604 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:44.013318 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] validate_networks() for [('08544471-7a68-4aa2-a2bf-b9cbb7450fd5', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:45.393528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=16 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:45.409345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.419971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.426595 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.429640 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e945a75c-c248-4688-bcee-5e3e5faa360b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 1.604507 Oct 02 00:56:45.450005 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 28/51] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:43 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:45.467208 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:45.468178 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:45.482716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.483816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.484430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.485357 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.488618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.489427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.978034 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:46.002739 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6d7ddf8c-1043-4b7e-90aa-8b62e9a6029b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1216 microversion: 2.1 time: 0.550301 Oct 02 00:56:46.010257 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 29/52] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:45 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1216 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:46.617806 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22f78b3-4968-4839-94f8-10f199e79b1b", "tag": "c2641b8d-0a17-42c1-8df2-86ee0d701f6a"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:46.678603 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.680585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.682929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.763594 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Creating event network-changed:c2641b8d-0a17-42c1-8df2-86ee0d701f6a for instance e22f78b3-4968-4839-94f8-10f199e79b1b on hv-cinder-maste Oct 02 00:56:46.766068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 00:56:46.767549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d729e0f5-e40c-4c36-89e4-f3b65744e066 req-10e0dd7a-0c4b-497d-83f5-1db7fa7b3ae3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 00:56:46.771632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.773793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.775821 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.776922 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.778601 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.781034 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.832366 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.compute.rpcapi [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 00:56:46.849844 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 00:56:46.911602 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9afdd617-f7ec-4aa1-811e-be75d672b8a4 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.899718 Oct 02 00:56:46.920666 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 30/53] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:46.950319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:46.954581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.978155 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.983393 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.986472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.989560 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:47.005617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:47.013303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.142420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:48.144172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:48.145860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:48.146881 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:48.147477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:48.188809 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.192713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.194144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.196450 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.199774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.202935 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.264890 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:48.275975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for user 1f392d3cac0149b09d4f83e83a930298 and project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:48.302194 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:48.305435 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:48.472711 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ac8eeb87-fcd0-4807-8b8b-6e1e2d55c4d9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.394186 Oct 02 00:56:48.483851 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 24/54] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 5404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:48.507594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:48.508565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:48.533197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.538293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.539489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.540927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.542960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.545916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.792217 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.803373 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-66d8ad85-68b0-4543-bd00-37fec2fa5b0f tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 1.875806 Oct 02 00:56:48.834358 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 31/55] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:46 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:48.859908 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:48.866300 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:48.918549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.919194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.919650 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.920384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.920837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.921402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.553929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.585264 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1b76a19a-12d5-4534-865e-8f0622c2044e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1278 microversion: 2.1 time: 0.748978 Oct 02 00:56:49.590436 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 32/56] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:48 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1278 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:49.613060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a5aeae09-68bb-4ed3-8ec2-9b838f7d5bb6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:49.615349 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a5aeae09-68bb-4ed3-8ec2-9b838f7d5bb6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:49.688157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.719139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.729924 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.731470 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0cbfbc7a-2863-4a33-b129-526cce2a584b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 1.240151 Oct 02 00:56:49.737306 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 25/57] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:48 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:49.773271 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:49.832097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.845638 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.852180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.932537 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Creating event network-changed:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:56:49.936364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a5aeae09-68bb-4ed3-8ec2-9b838f7d5bb6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.945433 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a5aeae09-68bb-4ed3-8ec2-9b838f7d5bb6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1238 microversion: 2.1 time: 0.352363 Oct 02 00:56:49.946622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120760) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 00:56:49.946622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ee7d0c76-69dc-4817-adef-001c0481abeb req-d45aa892-039f-4544-a46b-9ec843ba950f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120760) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 00:56:49.952391 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.954683 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 33/58] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:49 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1238 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:49.961872 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.966700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.968985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.970740 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.972348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.980825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:49.983455 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:50.012096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.015876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.016450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.017968 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.compute.rpcapi [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 00:56:50.019585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.023131 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.024395 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] Releasing lock "compute-rpcapi-router" {{(pid=120760) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 00:56:50.027035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.086352 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c0b23955-89d9-4302-80c7-91826c3b68cb None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345592 Oct 02 00:56:50.098170 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 26/59] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:50.555036 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:50.564406 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d5b9d5be-050f-4571-b96a-8d2d249bd5d7 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.603416 Oct 02 00:56:50.566975 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 34/60] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:49 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:50.619079 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:50.619994 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:50.635511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.640203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.642459 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.645881 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.649195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.650041 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.767032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:50.767872 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:50.779807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.786297 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.788044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.791378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.792102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.792732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.722967 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.734725 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0639ea2c-e53c-4118-9f20-54d8ba9beab7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 1.119983 Oct 02 00:56:51.735927 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 27/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:50 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:51.752901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:51.753779 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:51.763020 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.763527 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.764087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.764806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.765706 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.766221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.867941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.880932 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.887895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.889423 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9a8a8db2-c79b-4260-bb58-8c8a6e28af72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 1.127124 Oct 02 00:56:51.901069 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 35/62] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:50 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:51.922290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:51.922911 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:51.933525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.934189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.934814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.935668 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.936316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.937188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.942637 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.959233 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4774e8aa-1012-4b3c-a7da-bb880c654396 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1290 microversion: 2.1 time: 0.216250 Oct 02 00:56:51.961508 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 28/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:51 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1290 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:52.318490 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.326636 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-318d9b2a-c98e-49ba-bced-70a7d4db3415 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.412534 Oct 02 00:56:52.329894 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 36/64] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:51 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:52.543643 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da7db91-0f99-4f2a-8d76-aa6544f7656f", "tag": "d280ff3c-bcab-4daf-bc79-66b95b2e94ba"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:52.561058 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.563031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.563851 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.586097 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] Creating event network-changed:d280ff3c-bcab-4daf-bc79-66b95b2e94ba for instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f on hv-cinder-maste Oct 02 00:56:52.608017 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-4d1b8690-be0c-4e5e-9fd8-1d970a8dae0e req-e1b82abd-018d-4b1d-9fec-4a4b17caa486 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.640150 Oct 02 00:56:52.614164 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 29/65] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:52.764148 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:52.764828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:52.777620 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.778483 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.779901 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.780807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.783338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.784637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.921912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:52.923353 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:52.932761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.936378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.938379 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.940902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.942445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.944600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.957075 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.975201 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bcf72287-a398-460d-ae9b-b963fd24a3e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.211752 Oct 02 00:56:52.979365 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 37/66] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:52 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:52.991862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:52.998333 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:53.013692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.016785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.017734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.019310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.020161 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.020804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.133579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.147465 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d9fd225b-0143-4874-9c07-4b71d9bf7fd4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1308 microversion: 2.1 time: 0.160880 Oct 02 00:56:53.148095 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 38/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:52 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:53.268893 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.293454 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.293454 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.293454 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cb734b8f-e981-4509-981a-24f23f76487b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.373306 Oct 02 00:56:53.293676 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 30/68] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:52 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:53.359458 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:53.360594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:53.370558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.371613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.372372 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.373795 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.375390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.376658 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.409977 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:53.683793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.706628 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-70f4d761-1919-46d6-a8f9-4991e8207ef6 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.353778 Oct 02 00:56:53.707906 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 39/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:53 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:53.748314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76ff8dd-f683-4998-93ca-4909712234a6", "tag": "985125fa-5191-425d-9bff-098da17e4a16"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:53.761224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.762124 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.762556 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.774623 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] Creating event network-changed:985125fa-5191-425d-9bff-098da17e4a16 for instance e76ff8dd-f683-4998-93ca-4909712234a6 on hv-cinder-maste Oct 02 00:56:53.780331 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-215dd2b6-14d2-470b-98f4-f6fc895712ee req-930396b7-2bea-45be-9150-a63caefd34a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037478 Oct 02 00:56:53.780957 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 31/70] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:54.006465 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.007832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.016688 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.017904 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.019245 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.020503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.021409 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.022141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.176347 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.177096 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.196789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.197324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.197770 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.198482 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.198941 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.199372 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.682408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:54.694952 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-62c419ce-a64f-46cb-97bd-fd4a8f8b84ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1308 microversion: 2.1 time: 0.523278 Oct 02 00:56:54.696036 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 32/71] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:54.706285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.714725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.723445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.730899 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.731855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.732964 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.733670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.734234 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.928406 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:54.944175 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-cb6ecb62-00ee-4726-bd16-647118a30813 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.938363 Oct 02 00:56:54.947964 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 40/72] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:54.967056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.970112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.993163 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.996058 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.999400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.000239 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.001804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.002517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.320393 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.323882 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=51 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:55.333272 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.335943 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.338971 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-88aabe3d-ff2c-4b0c-aff7-41e73defb771 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.641073 Oct 02 00:56:55.340027 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 33/73] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:55.725117 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:55.726345 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:55.729592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:55.739397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.740102 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.740768 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.741734 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.742400 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.743044 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.765502 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.777714 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b686ecf4-e87d-4c95-b210-4f2295ed5c9d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.828111 Oct 02 00:56:55.778304 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 41/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:55.918336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.930050 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7d6652cb-62a2-4ed8-9719-d88e0ec1378d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1296 microversion: 2.1 time: 0.209799 Oct 02 00:56:55.931053 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 34/75] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:55 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:55.973190 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:55.974137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:55.981254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.982690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.983346 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.984292 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.985181 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.985891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.374492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:56.375651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:56.384845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.385655 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.386260 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.386972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.387429 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.387852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.807629 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.823852 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a0d15cbd-9f6e-4ebd-8670-5f8c29388476 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.849994 Oct 02 00:56:56.827495 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 42/76] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:55 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:56.842810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:56.845187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:56.851371 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:56.855891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:56.871516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.873134 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.874561 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.876110 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.881333 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.882156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.987689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.014164 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.016854 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.027751 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-24d9af7d-e335-4d5f-990e-98fa6342c271 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.657293 Oct 02 00:56:57.036067 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 35/77] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:56 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:56:57.041390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:57.044589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:57.072596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.073323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.080066 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.081062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.081653 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.082328 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.663188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.670456 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.673456 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5c3e5bfd-4433-4c6e-9db1-33add6f4ece5 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.844339 Oct 02 00:56:57.682458 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 43/78] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:56 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:57.706931 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d9365e63-83b0-40b0-b4e6-7734f533bb74 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.669456 Oct 02 00:56:57.708526 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 36/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:57 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:57.854642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:57.856815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:57.868319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.870740 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.871440 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.873231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.874544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.875168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.069453 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.070656 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.083136 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.084000 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.084689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.085880 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.090217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.090926 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.293752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=30 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:58.343279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.354412 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-61a67e5b-7be2-4338-a5fe-cf1e0168a760 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.504654 Oct 02 00:56:58.355310 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 44/80] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:57 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:58.698102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.698525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.707920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.708434 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.708880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.709683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.710150 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.710583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.727356 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.744901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.747945 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.753843 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-70b18aba-b872-4eb6-b29b-5db1d1e5f0c5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.691910 Oct 02 00:56:58.761837 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 37/81] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:56:58.775593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.776775 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.808763 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.810156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.812646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.817923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.818691 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.819816 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.315928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.328292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.342071 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e698d1ec-9fa4-4f17-81cc-bd1ceff34f1c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.578983 Oct 02 00:56:59.342784 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 38/82] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:59.371722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b015e40c-98d7-4fec-98e1-ad84b496767b", "tag": "a3490b59-f6e1-446d-9de3-9df384b29702"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:59.380504 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-53ceb2f4-958f-4027-8e13-7990a707284c tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.682818 Oct 02 00:56:59.397361 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 45/83] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:59.412328 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:59.413074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:59.415420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.421535 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.422136 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.422699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.423518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.423798 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.425544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.426011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.427422 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.472920 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] Creating event network-changed:a3490b59-f6e1-446d-9de3-9df384b29702 for instance b015e40c-98d7-4fec-98e1-ad84b496767b on hv-cinder-maste Oct 02 00:56:59.491741 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-c48d1122-6f38-46ce-a3fb-fb6b0b6d523e req-af4c5dd7-dedc-4334-b61d-c0b91ffb9292 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146986 Oct 02 00:56:59.493591 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 39/84] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:59.772164 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.782517 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-19f0e597-c490-492a-af1d-9af7f5cb0a73 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.383765 Oct 02 00:56:59.783212 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 46/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:59 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:59.802894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:59.805038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:59.819384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.820492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.822479 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.825616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.826453 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.829056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.010426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=10 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:00.090715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.102546 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.104732 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.106419 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0a2116b7-d38f-4c2c-b89d-7c19b518a53f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.314279 Oct 02 00:57:00.107507 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 40/86] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:59 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:00.376601 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:00.377902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:00.380106 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:00.393500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.395338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.398564 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.399817 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.400671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.401735 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.416752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:00.418583 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:00.439314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.444613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.447023 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.448092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.452597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.453509 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.937344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.949832 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8cf74a5b-eeea-4721-941a-88651d05855d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.575325 Oct 02 00:57:00.950667 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 47/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:00 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:00.965340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:00.965965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:00.985437 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.985956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.986525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.987271 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.987923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.988355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.031485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.064268 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e682bd59-2feb-4a42-ae0f-7fd64290310b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.651273 Oct 02 00:57:01.074599 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 41/88] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:00 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:01.139593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:01.140715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:01.202474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.203195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.203674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.204451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.204906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.205942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.564198 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.574600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.577806 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7b2857e3-9d91-41e0-a578-e292faef2537 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.622791 Oct 02 00:57:01.579548 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 48/89] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:00 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:01.591850 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.594510 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.599725 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-57ddd12d-e5c5-4661-8625-5eb4d2e74224 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.467867 Oct 02 00:57:01.619523 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 42/90] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:01 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:01.992156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:01.992870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.004765 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.005301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.005755 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.006463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.007054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.007488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.321937 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.354110 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-946af243-479c-48ff-985e-282ea394fb0e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.365149 Oct 02 00:57:02.356193 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:01 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:02.371464 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.374386 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.396501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.400312 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.401494 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.402318 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.402918 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.403612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.678009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "name": "network-vif-plugged", "status": "completed", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:02.703145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.707340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.707846 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.714287 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.716175 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a3c86c91-9ff6-4290-be10-72c0d241572a tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.357195 Oct 02 00:57:02.719041 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 44/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:02.728264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.729176 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.747269 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.750062 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] Creating event network-vif-plugged:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:57:02.750836 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.754143 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.755343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.755980 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.756578 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.770452 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-d31cb11a-a34b-44c9-80e4-d404364624c2 req-b0ddfa8a-4725-4cf7-a1ad-c32dece7c80d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.817291 Oct 02 00:57:02.771583 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 49/93] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:02.778762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.779476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.789132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.790048 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.790715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.791455 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.792125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.792709 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.050052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.058875 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-925abef4-5785-48f1-976f-d57650a17c13 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.338439 Oct 02 00:57:03.059472 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 45/94] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:03.072503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.083708 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.085687 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.087233 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-93760b93-6b1a-4bda-9ceb-f578681fdc24 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.312785 Oct 02 00:57:03.088491 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 50/95] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:03.389341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:03.392005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:03.400337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.401432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.402356 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.404475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.405309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.405985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.669404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.684741 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-78b4c0c6-f7bb-4b2f-bceb-76771e751215 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.304824 Oct 02 00:57:03.686392 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 46/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:03 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:03.751011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:03.752559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:03.762130 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.764039 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.765133 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.766651 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.767328 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.769054 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.088384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.089252 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.099203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.100834 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.101997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.102971 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.103796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.104833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.108719 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.121240 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-14a4731b-a1d5-4a49-aff9-e7f5b1959d9b tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.374956 Oct 02 00:57:04.124413 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 51/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:03 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:04.134575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.135213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.157500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.157500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.157500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.157500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.160082 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.161479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.661094 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.672918 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a2d6e0b3-2adf-4d8c-b5a7-ea2892751b47 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.592816 Oct 02 00:57:04.673533 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 47/98] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:04.694598 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.711995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.712678 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.713150 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.717144 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.718313 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4279b473-8a45-467b-be9e-29971044d750 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1408 microversion: 2.20 time: 0.592847 Oct 02 00:57:04.718934 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 52/99] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1408 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:04.723065 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.723765 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.724346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.725254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.726038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.726705 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.821307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22f78b3-4968-4839-94f8-10f199e79b1b", "name": "network-vif-plugged", "status": "completed", "tag": "c2641b8d-0a17-42c1-8df2-86ee0d701f6a"}, {"server_uuid": "8da7db91-0f99-4f2a-8d76-aa6544f7656f", "name": "network-vif-plugged", "status": "completed", "tag": "d280ff3c-bcab-4daf-bc79-66b95b2e94ba"}, {"server_uuid": "e76ff8dd-f683-4998-93ca-4909712234a6", "name": "network-vif-plugged", "status": "completed", "tag": "985125fa-5191-425d-9bff-098da17e4a16"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:04.835690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.836787 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.837551 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.857169 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Creating event network-vif-plugged:c2641b8d-0a17-42c1-8df2-86ee0d701f6a for instance e22f78b3-4968-4839-94f8-10f199e79b1b on hv-cinder-maste Oct 02 00:57:04.857690 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Creating event network-vif-plugged:d280ff3c-bcab-4daf-bc79-66b95b2e94ba for instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f on hv-cinder-maste Oct 02 00:57:04.858200 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] Creating event network-vif-plugged:985125fa-5191-425d-9bff-098da17e4a16 for instance e76ff8dd-f683-4998-93ca-4909712234a6 on hv-cinder-maste Oct 02 00:57:04.869519 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-b67cd5f8-ad5c-435a-8a40-71a122738d04 req-c8e007d3-ef11-453b-9c67-218b123464c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056337 Oct 02 00:57:04.871150 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 53/100] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:05.029008 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:05.050014 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-141eb84c-ce8d-42ed-af0e-eb95daa84507 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.343416 Oct 02 00:57:05.072899 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 48/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:05.145641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:05.146511 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:05.166973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.169204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.169590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.170669 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.176179 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.177387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.453736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:05.467303 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6b0f7b64-05c9-40d5-907f-8c8d481e0ea8 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.326522 Oct 02 00:57:05.485967 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 54/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:05 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:05.588270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-128667476", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "6ca34b62-c7ff-456b-b80e-b28dff98716d"}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:05.703000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:05.703893 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:05.716111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.716903 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.717915 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.720137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.720356 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] validate_networks() for [('6ca34b62-c7ff-456b-b80e-b28dff98716d', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:57:05.721684 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.723734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.154330 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.165697 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-67f4f6ac-f445-45cb-974d-fe5d65c4af9d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.468972 Oct 02 00:57:06.166282 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 55/103] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:05 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:06.170810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:06.177113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:06.193479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.193987 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.194428 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.195137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.195600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.196028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.472653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.482582 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.484170 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.485648 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-38bec251-4786-464e-bf01-a04a09e43ad1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1600 microversion: 2.20 time: 0.318445 Oct 02 00:57:06.487694 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 56/104] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:06 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1600 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:06.493782 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:06.495021 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:06.504905 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.505732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.506370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.508600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.509241 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.509852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.531435 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:06.537368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:57:06.537798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:57:06.538273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:57:06.538686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:57:06.539106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:57:06.550217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.550713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.551152 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.551882 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.552339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.552765 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.570654 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Getting quotas for project 1aff223229af423dabb6cf1589554a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:57:06.574848 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Getting quotas for user 7b9806fefa0042a380af7ac1175c53d7 and project 1aff223229af423dabb6cf1589554a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:57:06.599228 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:57:06.602118 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:57:06.661052 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0649d877-5f91-4b4f-b942-9fb9e540f1c7 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317146 Oct 02 00:57:06.661874 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 49/105] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:57:06.668900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:06.669680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:06.676544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.677077 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.677511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.678249 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.678710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.681566 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.681731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.690285 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e3702ad3-66fb-4187-8798-368ba336f5b5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.200854 Oct 02 00:57:06.690787 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 57/106] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:06 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:06.707567 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:06.707926 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:06.722095 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.722785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.723326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.724230 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.724834 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.725371 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.988739 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b06b9794-ae1c-4b52-8411-01b774c1f987 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.296858 Oct 02 00:57:06.993610 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 58/107] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Oct 2 00:57:06 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-interface => generated 285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:57:07.011233 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6f095b4f-017c-42e2-b030-5c92030e9f72 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:07.012177 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6f095b4f-017c-42e2-b030-5c92030e9f72 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:07.032738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.087545 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a49ef55e-2d79-442e-8278-1fe7cb4ebc51 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.424310 Oct 02 00:57:07.088352 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 50/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:06 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:07.096363 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6f095b4f-017c-42e2-b030-5c92030e9f72 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.110159 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6f095b4f-017c-42e2-b030-5c92030e9f72 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1213 microversion: 2.1 time: 0.105551 Oct 02 00:57:07.111981 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 59/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:07 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:07.121486 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b015e40c-98d7-4fec-98e1-ad84b496767b", "name": "network-vif-plugged", "status": "completed", "tag": "a3490b59-f6e1-446d-9de3-9df384b29702"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:07.156791 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.157314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.157751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.170964 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] Creating event network-vif-plugged:a3490b59-f6e1-446d-9de3-9df384b29702 for instance b015e40c-98d7-4fec-98e1-ad84b496767b on hv-cinder-maste Oct 02 00:57:07.177352 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-c19f4292-579d-41c4-9ec0-767f6c84d481 req-07368155-f447-40af-b949-c34493e87a06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084980 Oct 02 00:57:07.177963 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 51/110] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:07.190598 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:07.191843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:07.201841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.202352 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.202794 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.206630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.207359 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.207964 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.459931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.468092 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aec08817-4b6b-4894-adfd-b121d3419aaf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1320 microversion: 2.1 time: 0.283350 Oct 02 00:57:07.488357 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 60/111] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:07 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:07.741130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:07.742293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:07.749648 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.750135 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.750763 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.751616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.753053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.753631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.774015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:07.985501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.998807 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1cbbc708-b37f-4c99-91fb-963a15460e7d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.262812 Oct 02 00:57:07.999717 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 52/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:07 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:08.115033 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.115661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.122008 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.122702 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.123141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.124139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.124734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.125326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.138358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.139617 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.148469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.149224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.150201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.151310 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.152309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.153492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.242439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.251002 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5864bee6-9059-4edc-a37a-f8034964d3c5 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1217 microversion: 2.1 time: 0.118301 Oct 02 00:57:08.252464 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:08.317744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.329094 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d36b3033-4c79-4e20-bb7c-e767ac8f8f7d tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1315 microversion: 2.1 time: 0.218496 Oct 02 00:57:08.349987 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 61/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:08.510806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.511828 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.519753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.520752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.521213 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.521921 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.522414 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.522840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.685957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.695438 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9b5368c5-6eaf-486d-bbb5-8b0dd2de4522 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1514 microversion: 2.1 time: 0.188395 Oct 02 00:57:08.696023 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 54/115] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:08.723414 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:08.728515 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.736884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.738166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.738166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.738928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.739309 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.739748 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.788348 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'flavor' on Instance uuid e76ff8dd-f683-4998-93ca-4909712234a6 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:57:08.827776 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:08.838504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.838990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.839466 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.851591 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] Creating event network-changed:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:57:08.856913 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-8feb29fb-4cfd-4ecf-b7ea-9f2991169e26 req-1e4acc1e-1559-4e7d-a671-033e714cbe06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032725 Oct 02 00:57:08.860605 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 55/116] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:08.933524 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c416ee6f-a642-458a-8b70-4dcfbd87c317 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6/action" status: 200 len: 32 microversion: 2.1 time: 0.215313 Oct 02 00:57:08.934296 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 62/117] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:57:08 2022] POST /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:57:08.957156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.957156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.957156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.957156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.957512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.957512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.957512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.957512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.030690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:09.031450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:09.041421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.041939 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.042352 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.057375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.057375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.057375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.188782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.200179 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3e97fc58-63d8-4e5e-bb6e-fe6e40e73bd9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.259555 Oct 02 00:57:09.203125 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 56/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:09.251137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.262722 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9cf549b0-1819-4106-a650-2b166f0b07d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.237015 Oct 02 00:57:09.263340 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:09 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:09.276377 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:09.277405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:09.284323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.285294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.285902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.286907 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.287529 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.288112 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.352183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:09.353514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:09.355408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.362258 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.362908 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.363530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.364225 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.364820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.365366 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e00809eb-e10d-4b94-8855-5ec76ca975a2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1209 microversion: 2.1 time: 0.092713 Oct 02 00:57:09.365505 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.377980 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:09 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:09.616549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.629693 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b59e1f20-36ac-429a-a2dd-1fcad1715298 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1502 microversion: 2.1 time: 0.281286 Oct 02 00:57:09.630526 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 64/121] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:09 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:10.228193 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.228719 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.237223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.237803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.238323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.239100 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.239631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.240068 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.295730 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.296855 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.314017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.315509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.319126 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.320663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.323153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.323929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.536230 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:10.544006 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-226eefc1-b735-4b3c-b826-aaf9ffc07a8a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.320103 Oct 02 00:57:10.544506 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 58/122] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:10.557081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:10.557685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.557685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.557847 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3a5188a7-2efa-4943-8a27-76ac46a6460f tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.266668 Oct 02 00:57:10.557847 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:10.562526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.563019 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.563457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.564186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.564735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.565212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.628796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:10.636574 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c1c1a2e6-be94-429c-8020-2ab04755449e tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1265 microversion: 2.1 time: 0.087338 Oct 02 00:57:10.637177 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 59/124] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:11.247630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f956376-70e0-4237-8ed8-26792f90fa2f"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:11.249962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:11.256600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.257234 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.257634 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.258338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.258792 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.259242 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.571488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:11.573637 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:11.582286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.583146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.583798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.584866 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.585739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.586687 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.747203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.755957 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f62a7a38-6f8f-4b42-a220-ea08b05766fe tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.191259 Oct 02 00:57:11.756893 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:11 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:11.761905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:11.762948 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:11.770269 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.771137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.771756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.772801 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.773491 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.774115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.946378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.958946 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-20563865-9875-4436-b842-0b521555446e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1363 microversion: 2.1 time: 0.200716 Oct 02 00:57:11.959645 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 61/126] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:11 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:11.965818 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:11.966849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:11.974704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.975551 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.976090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.977183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.977939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.978532 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.068603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.108005 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6fd96246-caa7-4892-9790-e92348d10f32 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1265 microversion: 2.1 time: 0.141670 Oct 02 00:57:12.117423 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 62/127] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:11 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:12.257926 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-429c04e4-9d4c-4772-9a82-428c995b32a0 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "POST /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014127 Oct 02 00:57:12.261261 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 66/128] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:57:11 2022] POST /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:12.788748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:12.789376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:12.806373 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.807260 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.808046 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.809189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.809842 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.810277 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.999068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.000139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.007052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.008398 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.009009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.009971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.010577 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.011218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.054183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.066715 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c2969235-a5f6-44b0-8289-4e1f8cacd5e3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.283933 Oct 02 00:57:13.068312 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 63/129] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:12 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:13.145762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.147382 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.159561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.160792 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.161680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.163265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.164261 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.165847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.273572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.290914 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3831290d-356b-4010-bafa-96bdcf8963cd tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1273 microversion: 2.1 time: 0.150155 Oct 02 00:57:13.293063 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 64/130] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:13 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:13.386337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.402355 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c1513a44-7ae5-42e1-911c-472d92b6b0d8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1550 microversion: 2.1 time: 0.408905 Oct 02 00:57:13.403224 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 67/131] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:12 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1550 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:13.435090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.435594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.451358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.452142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.452790 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.453878 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.455098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.455887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.742683 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-53d37ec0-7d10-43a8-8216-60ab2fd3fb96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312094 Oct 02 00:57:13.743300 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 65/132] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 00:57:13 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:14.100557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:14.101907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:14.113831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.115657 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.116295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.118466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.119317 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.120055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.326442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:14.327859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:14.336825 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.337372 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.338172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.339581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.340518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.341527 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.505207 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:14.505207 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5fe24a6d-8f89-4927-bab9-268275404fab tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1271 microversion: 2.1 time: 0.181168 Oct 02 00:57:14.505207 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:14 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:14.531805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:14.541801 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a8148fbf-8cae-4865-ba75-1db6b1c0ddda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.449751 Oct 02 00:57:14.543995 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 68/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:14 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:15.543017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:15.545989 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:15.576044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:15.591107 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:15.595022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.595874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.596624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.602049 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.603254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.607064 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.642501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.642501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.642501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.642979 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.644107 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.644716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.916735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.935271 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f970b6a0-c67e-462e-8074-fc160d3a9ec2 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1271 microversion: 2.1 time: 0.407169 Oct 02 00:57:15.952600 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:15 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:16.457336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.465960 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bd3c4cbb-314d-4c11-b08c-538c4598ff72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.900246 Oct 02 00:57:16.468983 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 69/136] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:15 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:16.871689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b015e40c-98d7-4fec-98e1-ad84b496767b", "tag": "a3490b59-f6e1-446d-9de3-9df384b29702"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:16.886793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:16.893539 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:16.914792 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.915273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.915718 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.948475 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] Creating event network-changed:a3490b59-f6e1-446d-9de3-9df384b29702 for instance b015e40c-98d7-4fec-98e1-ad84b496767b on hv-cinder-maste Oct 02 00:57:16.971242 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:16.976481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:16.982290 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-4893f135-e20f-4fa4-8735-914fdfe263d0 req-60046c1c-38ac-4311-aab4-77ff0cbbd970 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113089 Oct 02 00:57:16.986215 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 68/137] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:17.034869 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.035729 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.036375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.037499 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.038219 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.038851 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.102209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:17.209374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.210346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.223728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.228049 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.230476 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.231501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.232199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.233062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.286651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:57:17.403864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:17.424451 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-146922da-ba4b-4e27-a79a-1da182dae7fb tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.467340 Oct 02 00:57:17.427128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:17.431631 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:16 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:17.493418 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.494433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.504776 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.505995 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.507077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.508517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.515917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.517142 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.573526 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3e589d2c-a2aa-4875-97da-75dfa51fadbe tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 204 len: 0 microversion: 2.1 time: 0.370001 Oct 02 00:57:17.579548 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 69/139] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:57:17 2022] DELETE /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:57:17.605565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.611902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.636169 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.640105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.641882 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.645166 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.647965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.649402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.955943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:17.966099 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ddb01dfe-eecc-4ae7-9b25-4c871643e538 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.477222 Oct 02 00:57:17.967351 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 71/140] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:17 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:18.146319 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.159022 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-890bdc7a-7d41-4ef7-937e-a17eb3c12190 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1554 microversion: 2.1 time: 0.572861 Oct 02 00:57:18.160053 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:17 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1554 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:18.466731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:18.467865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:18.494586 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.495399 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.496982 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.498733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.499528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.500258 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.507680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:18.763402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.775734 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a645aaf8-26ed-400d-a4fd-716f472f9d4a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.324198 Oct 02 00:57:18.776663 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 72/142] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:18 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:18.993772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:18.994822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.007076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.007778 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.008440 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.009134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.009885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.010312 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.035357 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d", "tag": "b83ab7f2-55d2-496e-8854-041e63825372"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:19.049310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.049798 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.050215 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.076433 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] Creating event network-changed:b83ab7f2-55d2-496e-8854-041e63825372 for instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d on hv-cinder-maste Oct 02 00:57:19.087596 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-fadd10fe-e92b-4038-821d-305ea6fb82f9 req-553bb075-f664-4cb8-9e39-427db333df23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058110 Oct 02 00:57:19.101051 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 73/143] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:19.191860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:19.197004 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.209260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.214295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.215202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.219694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.222366 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.225295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.279564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:19.291197 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-87f5cc55-7654-463e-986a-1141cd610f45 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.301749 Oct 02 00:57:19.292674 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 71/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:18 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:19.488385 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:19.501247 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-16580942-2fbd-4aa3-85f3-c6f94a73a3b3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1554 microversion: 2.1 time: 0.318342 Oct 02 00:57:19.502831 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 74/145] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:19 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:19.803994 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:19.804519 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.810614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.811116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.811781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.812434 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.812888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.814079 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.967673 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:19.975533 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-722cca45-b96f-45b7-a5ff-f5e61223fa2a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.175568 Oct 02 00:57:19.976110 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 72/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:19 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:20.316667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:20.317550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:20.324318 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:20.325614 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:20.326282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:20.327478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:20.328139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:20.328666 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:20.529575 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:20.530950 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:20.550996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:20.553772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:20.554261 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:20.555140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:20.555694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:20.557330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:20.760507 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:20.773981 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2227fedd-670a-4c53-8327-49bf50b570f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.462143 Oct 02 00:57:20.776521 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 75/147] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:20 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:20.996810 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:21.002624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:21.003564 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:21.028874 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ae776742-f849-4d15-b092-80f8b196e014 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1554 microversion: 2.1 time: 0.504835 Oct 02 00:57:21.029404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.030393 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.033356 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 73/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:20 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1554 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:21.034459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.035355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.035748 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.036217 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.205982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22f78b3-4968-4839-94f8-10f199e79b1b", "name": "network-vif-deleted", "tag": "c2641b8d-0a17-42c1-8df2-86ee0d701f6a"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:21.222263 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:21.242784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.246528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.247894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.280534 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] Creating event network-vif-deleted:c2641b8d-0a17-42c1-8df2-86ee0d701f6a for instance e22f78b3-4968-4839-94f8-10f199e79b1b on hv-cinder-maste Oct 02 00:57:21.299413 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-a8bcf67e-e285-4e4a-93e6-91f2e073b972 req-f2b96f63-1787-474c-abaf-f80a52a52524 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100622 Oct 02 00:57:21.300757 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 74/149] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:21.471080 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:21.487485 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fdf439d1-d72d-4ed7-bdbd-244ab9be5df0 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.489622 Oct 02 00:57:21.488105 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 76/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:20 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:21.808886 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:21.808886 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:21.831242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.832175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.833204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.842479 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.843528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.844367 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.046320 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:22.054945 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4f46205d-2f7e-47da-9d79-90e64cad65be tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.257200 Oct 02 00:57:22.055647 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 75/151] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:21 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:22.062314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:22.064143 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:22.071288 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.071784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.072218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.072915 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.073510 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.073831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.171433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:22.187645 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d3ff15c5-fb19-4e7e-8c94-d4e16bd685b1 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1346 microversion: 2.1 time: 0.129054 Oct 02 00:57:22.189159 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 77/152] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:22 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:22.514248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:22.515343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:22.523465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.523955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.524385 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.525283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.525788 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.526257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.686550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:22.699606 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f8de8073-1b8d-4ae0-80cd-390fdecc086a tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.189941 Oct 02 00:57:22.700218 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 76/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:22 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:23.081481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:23.082104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:23.090024 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.090529 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.090971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.091885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.092348 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.092780 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.227534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:23.228741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:23.238909 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.239617 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.240408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.241443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.242376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.242885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.250151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.265025 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f4608311-4af0-41c8-a73f-30006073d2b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.186564 Oct 02 00:57:23.266115 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 78/154] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:23 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:23.293789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.294359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.294864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.295765 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lazy-loading 'fault' on Instance uuid e22f78b3-4968-4839-94f8-10f199e79b1b {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:57:23.355023 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a82acab3a5b4808b62a72adf3c61d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28bdfe12d4a6a956d0f52696c3721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.367865 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cb1ccfbd-f83f-47b1-80ec-ab9072225d03 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 200 len: 1351 microversion: 2.1 time: 0.146093 Oct 02 00:57:23.381543 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 77/155] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:23 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 1351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:23.729072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:23.730358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:23.737941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.738730 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.739550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.740344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.741063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.741898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.885587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1677598314", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "c05c623a-66ff-43b1-8713-87216e762a99"}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:23.917947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.926689 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0d643606-6b0d-4b00-806a-881313ef65a8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.205164 Oct 02 00:57:23.928620 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 79/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:23 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:23.947584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] validate_networks() for [('c05c623a-66ff-43b1-8713-87216e762a99', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:57:24.292212 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.294939 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.306862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.308039 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.309108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.310517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.311546 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.312532 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.451574 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:57:24.452145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:57:24.452446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:57:24.452845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:57:24.453581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:57:24.469007 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.469710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.470417 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.471301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.472034 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.472621 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.491716 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Getting quotas for project c4bf24ea75824896bf7c33c3037e3654. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:57:24.497762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Getting quotas for user 7abd8f370307422880a120981aa4b755 and project c4bf24ea75824896bf7c33c3037e3654. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:57:24.512908 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:57:24.515464 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:57:24.576875 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5600bcc6-4a72-4218-92ea-5dea30f5d8bc tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695549 Oct 02 00:57:24.578039 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 78/157] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:57:24.585465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.586444 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.596389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.596963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.597401 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.598359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.598820 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.599244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.603686 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:24.624913 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c321d5c0-5096-442e-97bc-615b489fac4d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.339919 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] HTTP exception thrown: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Request method failure captured: Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b HTTP/1.1 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG4VwaFYBuXPfCDlE7Yz3shz49BCNz-Xe0-cN5XTVhjVtKRkjhQDCLXI829QovpmQkH7YbCAWsuN22Qzt6dzM7JZD4tG73WqmwFX-nAsz7HGXuCusIUq4eGl08IpL8wI5Z7aGWTbxpwQilIamDzcPkL_JhFJ5-dmPBj6TLrmPxCdpU Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:57:24.643546 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 4a82acab3a5b4808b62a72adf3c61d48 Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.645111 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'e22f78b3-4968-4839-94f8-10f199e79b1b'} Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:24.645942 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.647273 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.648420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Returning 404 to user: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:24.648420 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e1d3668d-a0d3-4eb1-b2ee-a5ac96f6360e tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 404 len: 111 microversion: 2.1 time: 0.055240 Oct 02 00:57:24.648420 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:24.648420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-31d3181d-d992-4fec-bb2e-4cb69549d89b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.648420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-31d3181d-d992-4fec-bb2e-4cb69549d89b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.649257 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 80/159] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:24.702634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-31d3181d-d992-4fec-bb2e-4cb69549d89b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:24.713921 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-31d3181d-d992-4fec-bb2e-4cb69549d89b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1219 microversion: 2.1 time: 0.072871 Oct 02 00:57:24.714509 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:24.810487 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.813675 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.819930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.820431 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.821001 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.821647 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.822073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.822517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.837010 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] HTTP exception thrown: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Request method failure captured: Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b/os-volume_attachments HTTP/1.1 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG4VwaFYBuXPfCDlE7Yz3shz49BCNz-Xe0-cN5XTVhjVtKRkjhQDCLXI829QovpmQkH7YbCAWsuN22Qzt6dzM7JZD4tG73WqmwFX-nAsz7HGXuCusIUq4eGl08IpL8wI5Z7aGWTbxpwQilIamDzcPkL_JhFJ5-dmPBj6TLrmPxCdpU Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:57:24.842324 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 4a82acab3a5b4808b62a72adf3c61d48 Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.843757 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'server_id': 'e22f78b3-4968-4839-94f8-10f199e79b1b'} Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:24.845352 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:24.846410 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:24.848512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Returning 404 to user: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:24.848795 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fe05ef9b-2f50-45d7-9126-7bc5f50c20fb tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043596 Oct 02 00:57:24.849393 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 81/161] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:24.951719 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.967069 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.967633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.968136 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.969019 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.969550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.970033 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.378317 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.394903 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7d45bda6-36de-4f45-8212-369e40da1478 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.447092 Oct 02 00:57:25.396439 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:25.650114 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:25.650726 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:25.657685 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.658454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.659086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.660011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.660689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.661897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.743350 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:25.743908 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:25.753390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.753865 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.754474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.755352 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.755966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.756546 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.846769 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.862053 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-aa254b0e-b2c2-4003-a798-e8a73ab0d348 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1271 microversion: 2.1 time: 0.123843 Oct 02 00:57:25.863482 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 82/163] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:25 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:25.899623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.910933 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e4c2cc0a-65b5-462f-bc4d-009234728b1a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.264385 Oct 02 00:57:25.911654 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 82/164] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:25 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:26.101465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.101958 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.107795 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.108209 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.108641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.109364 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.109824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.110379 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.126489 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] HTTP exception thrown: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Request method failure captured: Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: DELETE /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b HTTP/1.1 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG4VwaFYBuXPfCDlE7Yz3shz49BCNz-Xe0-cN5XTVhjVtKRkjhQDCLXI829QovpmQkH7YbCAWsuN22Qzt6dzM7JZD4tG73WqmwFX-nAsz7HGXuCusIUq4eGl08IpL8wI5Z7aGWTbxpwQilIamDzcPkL_JhFJ5-dmPBj6TLrmPxCdpU Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:57:26.128149 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 4a82acab3a5b4808b62a72adf3c61d48 Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.129549 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'e22f78b3-4968-4839-94f8-10f199e79b1b'} Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:26.130199 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.131226 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.132288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Returning 404 to user: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:26.132288 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6c3988c8-e4b9-4873-87f7-15f9ca9bd8f3 tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 404 len: 111 microversion: 2.1 time: 0.032032 Oct 02 00:57:26.132288 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 83/165] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:57:26 2022] DELETE /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:26.138460 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.139284 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] [instance: e22f78b3-4968-4839-94f8-10f199e79b1b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.145948 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.146431 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.146868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.147559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.148009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.148432 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.166257 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] HTTP exception thrown: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Request method failure captured: Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b HTTP/1.1 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG4VwaFYBuXPfCDlE7Yz3shz49BCNz-Xe0-cN5XTVhjVtKRkjhQDCLXI829QovpmQkH7YbCAWsuN22Qzt6dzM7JZD4tG73WqmwFX-nAsz7HGXuCusIUq4eGl08IpL8wI5Z7aGWTbxpwQilIamDzcPkL_JhFJ5-dmPBj6TLrmPxCdpU Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:57:26.168512 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9c28bdfe12d4a6a956d0f52696c3721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: f9c28bdfe12d4a6a956d0f52696c3721 Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-DeleteServersTestJSON-12309467 Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 4a82acab3a5b4808b62a72adf3c61d48 Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-DeleteServersTestJSON-12309467-project Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.170021 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'e22f78b3-4968-4839-94f8-10f199e79b1b'} Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:26.170726 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. Oct 02 00:57:26.171992 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:26.173955 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] Returning 404 to user: Instance e22f78b3-4968-4839-94f8-10f199e79b1b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:26.174544 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-386b490a-042b-464e-ba19-561f95fac8ce tempest-DeleteServersTestJSON-12309467 tempest-DeleteServersTestJSON-12309467-project] 10.222.0.26 "GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b" status: 404 len: 111 microversion: 2.1 time: 0.039915 Oct 02 00:57:26.175083 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/e22f78b3-4968-4839-94f8-10f199e79b1b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:26.427030 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.427647 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.429399 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d", "name": "network-vif-plugged", "status": "completed", "tag": "b83ab7f2-55d2-496e-8854-041e63825372"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:26.445493 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.448324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.449171 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.449771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.450669 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.451125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.451807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.452731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.456871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.482062 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] Creating event network-vif-plugged:b83ab7f2-55d2-496e-8854-041e63825372 for instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d on hv-cinder-maste Oct 02 00:57:26.493989 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-a625a57e-9996-461f-8ff2-685bedc23735 req-433f526a-3167-4ede-89de-8739b9f7e388 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075275 Oct 02 00:57:26.500290 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 84/167] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:26.656331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:26.665385 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-299830ed-a55e-4561-b071-e8f3f14117e8 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.241989 Oct 02 00:57:26.665969 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 84/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:26.888612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.890252 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.904884 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.906015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.907314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.908573 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.909698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.910904 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.953302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.955045 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.960528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=86 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:26.965436 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.966160 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.967223 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.968516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.969214 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.984742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.072646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.083868 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fd0556d3-3653-42ca-9f22-1b445948939c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1277 microversion: 2.1 time: 0.201032 Oct 02 00:57:27.086976 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 85/169] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:27.207769 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.221718 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-25acbdc3-4cfc-42c5-bc23-62d41e7746c4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.286966 Oct 02 00:57:27.222692 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 85/170] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:27.689932 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:27.690447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:27.696655 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.697184 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.697830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.699939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.700642 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.701342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.918891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.935843 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-33936e20-9e25-4687-80b3-b9506680e1ca tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.250323 Oct 02 00:57:27.936536 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 86/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:27 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:28.112059 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:28.113944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:28.120700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.121895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.122788 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.131621 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.132482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.133156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.247794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:28.248443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:28.261371 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.261894 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.262344 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.263067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.268055 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.269404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.306141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:28.315203 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2573c3b6-40b1-41b7-b248-18e4ce094ad5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.210710 Oct 02 00:57:28.330181 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 86/172] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:28 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:28.473354 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:28.491422 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1a461227-6277-4c0b-b203-8741e16c4248 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.248237 Oct 02 00:57:28.492058 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 87/173] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:28 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:28.962601 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:28.963894 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:28.972026 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.973159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.974112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.975287 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.976285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.977077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.145021 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.158292 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1523b86f-eeba-4384-acf2-ccc5566ed521 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1313 microversion: 2.1 time: 0.199675 Oct 02 00:57:29.158896 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 87/174] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:28 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:29.339837 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:29.341485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.349419 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.350095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.351297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.352025 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.352681 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.353345 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.523116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:29.524059 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.551859 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.552366 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.552808 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.553549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.554004 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.554423 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.660581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.672533 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-762d8e27-e025-4245-bbb1-da167548c9b1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.337026 Oct 02 00:57:29.673870 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 88/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:29 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:29.807203 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.818118 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ce92e0ce-1215-497a-adec-94ef7b26fc1d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.304319 Oct 02 00:57:29.819631 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 88/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:29 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:30.183276 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:30.184227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:30.191739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.192604 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.193330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.194276 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.194941 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.195582 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.442402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:30.458165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:30.460805 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5d1a1461-924f-43ce-ab33-ad7ac4c9ba22 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1496 microversion: 2.1 time: 0.281502 Oct 02 00:57:30.472516 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 89/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:30 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:30.700712 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:30.702062 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:30.717607 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.721661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.723503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.726012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.727690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.728435 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.844910 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:30.846558 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:30.862079 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.865177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.866611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.869238 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:30.873043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:30.874031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.121229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.138693 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-11a2940e-bcc4-4e15-88b5-42575463aa7d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.438694 Oct 02 00:57:31.140056 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 89/178] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:30 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:31.155486 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85428c9-8c3d-40b5-b776-b6d8770c19ae", "tag": "67bdabce-23a3-48b0-885b-673d2dbea340"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:31.183115 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:31.184570 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:31.185580 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.200173 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] Creating event network-changed:67bdabce-23a3-48b0-885b-673d2dbea340 for instance b85428c9-8c3d-40b5-b776-b6d8770c19ae on hv-cinder-maste Oct 02 00:57:31.218730 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-0e2baadf-9d45-4d9a-9ff3-d7a4c2bf30af req-ee66b8c6-d839-40e3-8f35-050d6c301eaf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073627 Oct 02 00:57:31.220708 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 90/179] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:31.245584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.254673 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a5aa06e9-1b45-409e-acde-5de0d1ea6e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.415845 Oct 02 00:57:31.256463 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 90/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:30 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:32.166279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:32.167000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:32.181499 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.182001 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.182453 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.183154 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.183613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.184040 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.241423 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:32.282752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:32.284154 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:32.301442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.305517 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.306537 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.314010 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.316885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.319584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.607415 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.618314 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a5b756c4-2b65-4a9e-9bd4-9123b7bec0d2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.455906 Oct 02 00:57:32.628748 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 91/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:32 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:32.731843 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.748211 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d2d24421-cb48-4498-99a3-e00dadf15807 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.471925 Oct 02 00:57:32.749355 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 91/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:32 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:33.643228 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.643940 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.653083 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.653863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.654509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.655611 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.656791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.657611 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.763376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.764489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.781748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.782334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.783617 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.784348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.784920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.785448 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.818519 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:57:33.837415 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:33.849860 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5a8dfce7-9022-49d9-b3f8-2647d2722d05 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.211089 Oct 02 00:57:33.851271 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 92/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:33 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:33.858206 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.858937 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.867392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.867919 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.868346 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.873236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.873717 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.874149 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.939210 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-29a44b02-356f-4ce6-8524-a777aa017fb3 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 204 len: 0 microversion: 2.1 time: 0.178967 Oct 02 00:57:33.945559 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 92/184] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:57:33 2022] DELETE /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:57:33.953056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.953870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.960389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.961822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.961822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.962088 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.962962 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.963381 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.068362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:34.077890 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9f0436cc-bdf3-4a50-bd5d-3160543ec6bb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.225269 Oct 02 00:57:34.078776 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:33 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:34.144780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:34.153667 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5427ffe5-a273-4e28-949f-61b2d8f2b536 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1502 microversion: 2.1 time: 0.206557 Oct 02 00:57:34.154265 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 93/186] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:33 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:34.876973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:34.878196 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:34.890204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.890924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.892158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.892974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.893464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.893895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.062744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.074126 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6b6f0d61-b599-4df6-9941-18fbf4a3871c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.203022 Oct 02 00:57:35.075047 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 94/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:34 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:35.102074 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:35.102682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:35.104751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:35.105772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=8 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:35.113184 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:35.113681 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:35.114133 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.114813 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:35.115485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:35.115908 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.181778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:35.182674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:35.190502 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:35.191381 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:35.192051 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.193140 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:35.193830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:35.194379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.348856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.357762 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b5ba4067-f73a-48d7-926c-18e9e01d6262 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.259441 Oct 02 00:57:35.359004 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 94/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:35 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:35.385970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.395641 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9e3b1f34-c872-45d9-a725-960597d43243 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1502 microversion: 2.1 time: 0.220192 Oct 02 00:57:35.396255 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 95/189] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:35 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:36.098257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:36.098859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:36.105056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.105686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.105980 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.106686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.107145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.107564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.265598 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.277975 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a13a86f7-c322-4f27-b19b-85c21a49fc9d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.184067 Oct 02 00:57:36.279837 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 95/190] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:36 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:36.384523 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:36.385438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:36.394952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.395932 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.396698 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.397863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.398544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.399162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.431521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:36.432867 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:36.442907 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.443939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.444607 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.445875 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.446561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.448162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.549663 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9806fefa0042a380af7ac1175c53d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff223229af423dabb6cf1589554a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.563214 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1e3e712e-b659-4d3c-b6fd-0b06284de05d tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 200 len: 1460 microversion: 2.1 time: 0.138176 Oct 02 00:57:36.564115 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 96/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:36 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 1460 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:36.587186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d", "name": "network-vif-deleted", "tag": "b83ab7f2-55d2-496e-8854-041e63825372"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:36.613512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.614263 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.614914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.634777 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] Creating event network-vif-deleted:b83ab7f2-55d2-496e-8854-041e63825372 for instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d on hv-cinder-maste Oct 02 00:57:36.644153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.649799 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-3c9d42fd-9cc5-4c5a-b54d-f6a50cf582c8 req-ff971353-ddb9-4914-ac5b-4970eac55ae5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067975 Oct 02 00:57:36.651033 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 97/192] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:36.654457 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c8d165f5-d5c4-422a-a217-7bb6d84ec2b4 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.275579 Oct 02 00:57:36.654971 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 96/193] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:36 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:37.303525 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.304226 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.310496 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.310981 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.311418 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.312138 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.312593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.313075 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.451142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.461385 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-45574e90-907d-455b-baca-7e6b049335ae tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.162115 Oct 02 00:57:37.462343 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 98/194] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:37.587102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.588481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] [instance: b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.595991 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.596716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.597312 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.598164 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.598948 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.599377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.613304 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] HTTP exception thrown: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Request method failure captured: Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d HTTP/1.1 Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOHcdzVVqI0glGfhvkIGpzgkLkU-e3x_tLXucsehH9Qy0t83YvCBiy_g0cJqrysYkjHnmDD2rjIgzbURsbEe3_WLqtWBRkJANB3Rl5qX3lW1O92nludtKb-rYyZWfZcaeoKtCxDBL12Ts_NE0qKwSxArXD3Nc9SnZLNtwfesYLTZses Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 1aff223229af423dabb6cf1589554a1c Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesActionsTest-1305559049 Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:57:37.615002 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1aff223229af423dabb6cf1589554a1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1aff223229af423dabb6cf1589554a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1aff223229af423dabb6cf1589554a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1aff223229af423dabb6cf1589554a1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesActionsTest-1305559049 Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 1aff223229af423dabb6cf1589554a1c Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesActionsTest-1305559049 Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesActionsTest-1305559049-project Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 7b9806fefa0042a380af7ac1175c53d7 Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesActionsTest-1305559049-project Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. Oct 02 00:57:37.616563 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d'} Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:37.618127 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. Oct 02 00:57:37.620173 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:57:37.622742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] Returning 404 to user: Instance b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:37.622742 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bbb8d61a-0586-4c0f-b94e-0ba83eb13f66 tempest-VolumesActionsTest-1305559049 tempest-VolumesActionsTest-1305559049-project] 10.222.0.26 "GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d" status: 404 len: 111 microversion: 2.1 time: 0.033210 Oct 02 00:57:37.622742 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 97/195] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/b8e1d878-d87b-47fa-a0e2-4b2eb5c4a77d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:37.678653 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.679373 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.685447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.685936 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.686423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.687110 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.687564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.688533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.877235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.885887 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-879eeca4-3fca-4faf-9360-18b265ee0f40 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.211146 Oct 02 00:57:37.886843 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 99/196] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:38.480072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85428c9-8c3d-40b5-b776-b6d8770c19ae", "name": "network-vif-plugged", "status": "completed", "tag": "67bdabce-23a3-48b0-885b-673d2dbea340"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:38.485631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:38.487299 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:38.490042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.490525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.490956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.495904 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.496323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.497198 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.498032 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.498637 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.499237 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.504199 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] Creating event network-vif-plugged:67bdabce-23a3-48b0-885b-673d2dbea340 for instance b85428c9-8c3d-40b5-b776-b6d8770c19ae on hv-cinder-maste Oct 02 00:57:38.509257 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-c42b77e3-e2c3-4b1b-b511-c3a068687678 req-a07bcfb6-38dc-438b-b70e-09fa55690076 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Oct 02 00:57:38.509863 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 98/197] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:38.649762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.657953 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f7040828-6cfb-4b9f-9264-5785b3f71450 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.176313 Oct 02 00:57:38.658882 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 100/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:38 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:38.909817 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:38.910525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:38.919146 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.919643 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.920084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.920784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.921337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.921811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.072750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.085887 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b6c97e8b-6eb2-4b52-88de-a78ef68c3f76 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.180602 Oct 02 00:57:39.097923 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 99/199] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:38 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:39.683185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:39.683846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:39.690699 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.691198 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.691628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.692473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.692900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.693415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.835788 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.844675 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-25716efe-fe4f-4953-90cc-1334a7f00a02 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1319 microversion: 2.1 time: 0.164755 Oct 02 00:57:39.856965 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 101/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:39 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:40.118188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:40.118802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:40.125961 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.126448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.126879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.127600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.128060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.128487 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.263080 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:40.271590 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b191aa68-07f6-4afd-a1ce-553902bdb75a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.157352 Oct 02 00:57:40.272165 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 100/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:40 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:40.867849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:40.868475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:40.874837 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.875303 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.875791 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.876483 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.876968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.877394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.011597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.020680 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-11966fb7-a5dd-409c-a05d-4e92d597468c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1507 microversion: 2.1 time: 0.156716 Oct 02 00:57:41.021370 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 102/202] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:40 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:41.294353 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:41.295692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:41.303546 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.304259 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.304698 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.305612 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.306351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.307061 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.499341 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.510402 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1228df94-ba55-46af-a977-681b1a9209f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.219934 Oct 02 00:57:41.511758 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 101/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:41 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:42.535913 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:42.536757 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:42.563426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.564194 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.564766 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.565612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.566740 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.566740 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.757224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:42.766909 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8e42432e-015b-49e7-be92-f881b5cbfa8d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.236226 Oct 02 00:57:42.767690 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 103/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:42 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:43.797072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:43.798449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:43.805485 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:43.806313 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:43.806917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:43.807789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:43.808437 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:43.809102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:43.967031 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:43.979998 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6e20c26f-0a55-4c7e-8fae-44ab1f745849 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.192754 Oct 02 00:57:43.980582 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 102/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:43 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:45.008399 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:45.009326 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:45.017783 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.018383 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.018955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:45.019790 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.020361 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.020967 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:45.166931 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:45.175514 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-196fe980-9b23-41e0-bb51-0b306c494518 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.171661 Oct 02 00:57:45.176100 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 104/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:45 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:46.198841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:46.199578 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:46.206793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:46.207295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:46.207724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:46.208424 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:46.208879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:46.209330 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:46.356778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:46.365180 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-75585e01-5321-468b-86ce-f539709e6548 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.170086 Oct 02 00:57:46.365979 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 103/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:46 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:47.390167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:47.391694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:47.399696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.400346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.401054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:47.401723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.402187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.402614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:47.424077 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:47.548980 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:47.556632 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6c4de81d-e5c8-48b5-afb7-8d1427ff090d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.170670 Oct 02 00:57:47.557233 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 105/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:47 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:48.582290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:48.582290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:48.587183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:48.587680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:48.588114 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:48.589030 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:48.589501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:48.589930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:48.748454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:48.757025 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a153e618-f6c8-4f4b-be3d-885ad4b35b7d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1520 microversion: 2.1 time: 0.181094 Oct 02 00:57:48.757591 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:48 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:49.788589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:49.789446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:49.796029 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.796635 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.797115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.800960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.801457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.801901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.951310 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:49.959844 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-948f19f8-33d3-45e5-9d42-588733db76d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1500 microversion: 2.1 time: 0.181203 Oct 02 00:57:49.960426 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 106/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:49 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:49.984848 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:49.985632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:49.992250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.992899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.993474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.994313 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.994876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.995489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:50.162063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:50.170213 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b2eca680-678c-48fd-a609-50147a01ec95 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1516 microversion: 2.1 time: 0.190058 Oct 02 00:57:50.170806 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 105/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:49 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:51.658185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:51.661581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:51.672389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.672895 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.673663 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.674996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.675733 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.676291 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.704702 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'flavor' on Instance uuid 8da7db91-0f99-4f2a-8d76-aa6544f7656f {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:57:51.863773 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-12798c87-36a7-4bba-b763-3a4100a97e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/action" status: 200 len: 32 microversion: 2.1 time: 0.211866 Oct 02 00:57:51.864652 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 107/212] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:57:51 2022] POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:57:51.880345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:51.881430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:51.893615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.894136 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.894596 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.895305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.896464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.896903 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:52.075315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:52.085122 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aff5510e-5d43-4ebd-b525-804dff968f35 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.211884 Oct 02 00:57:52.085855 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 106/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:51 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:53.110505 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:53.111378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:53.117616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:53.120685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.121995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.123709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.125531 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.126494 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.127160 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.424916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:53.433473 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e36b9d0c-1bc6-4736-8764-dc0e7048946c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.329143 Oct 02 00:57:53.434071 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:53 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:54.456893 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:54.458360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:54.464699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.465199 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.465635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:54.466325 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.466773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.467197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:54.689263 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:54.707056 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c4904e71-863e-413f-9d85-cc3eb5d54b6e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.248608 Oct 02 00:57:54.709320 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 107/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:54 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:55.731981 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:55.732593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:55.740436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:55.741246 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:55.742544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:55.743984 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:55.744686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:55.748156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:55.932032 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:55.943158 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ddfa05f5-a6db-4e5f-8e9a-7bc767e4d5bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.214902 Oct 02 00:57:55.943881 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 109/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:55 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:56.967520 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:56.968811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:56.975395 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.975882 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.976617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.977050 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.977476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.978404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:57.148496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:57.157337 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ead5a0fa-726d-44ef-a5db-aededb9ad994 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.193514 Oct 02 00:57:57.158244 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 108/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:56 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:57.487886 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-43609845", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "d3fad2df-2530-43f6-a4bf-529ca0895c27"}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:57.551111 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] validate_networks() for [('d3fad2df-2530-43f6-a4bf-529ca0895c27', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:57:58.109485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:57:58.109957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:57:58.110426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:57:58.110836 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:57:58.111243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:57:58.120870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.121855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.122331 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.123468 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.123958 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.125123 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.143145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Getting quotas for project f7ef11453bfe47d7a1e8a8ec84144362. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:57:58.147239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Getting quotas for user 5aa9341fc87840bc99378f1def51167b and project f7ef11453bfe47d7a1e8a8ec84144362. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:57:58.158876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:57:58.161368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:57:58.187859 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:58.189122 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:58.192063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=48 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:58.197845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.198415 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.198909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.199615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.200101 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.200732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.216092 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1b9b2999-4adc-4eb2-aa55-9c13edb3dfe2 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732824 Oct 02 00:57:58.216749 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 110/218] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 00:57:58.228342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-531e12cb-3d90-4538-a5d2-df4a28e8677e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:58.228985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-531e12cb-3d90-4538-a5d2-df4a28e8677e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:58.294142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-531e12cb-3d90-4538-a5d2-df4a28e8677e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.302935 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-531e12cb-3d90-4538-a5d2-df4a28e8677e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1212 microversion: 2.1 time: 0.078423 Oct 02 00:57:58.303947 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 111/219] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:58 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:58.385112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:58.572394 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.588161 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-27bd1c07-5e14-4159-b10c-96462a95bb72 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.404975 Oct 02 00:57:58.588968 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 109/220] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:58 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:59.326106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:59.326717 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:59.332754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.333270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.333900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.334603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.335055 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.335475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.401172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:59.409693 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e4f36916-17bf-4548-a810-bb717e02352c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1264 microversion: 2.1 time: 0.087449 Oct 02 00:57:59.410203 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 112/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:59 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1264 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:59.615725 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:59.616333 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:59.622966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.623448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.623877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.625096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.625545 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.625987 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.785341 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:59.793226 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7bfebfaf-96b2-4d32-bed6-3db83aa3a741 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.181367 Oct 02 00:57:59.793800 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 110/222] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:59 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:00.434037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:00.434762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:00.441953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.442644 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.443369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.444242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.444845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.445330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.648018 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.656240 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1bdce137-d16a-4ee0-9aeb-642225af2720 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.225764 Oct 02 00:58:00.656808 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 113/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:00 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:00.826738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:00.828854 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:00.835509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.836007 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.836497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.837182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.837643 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.838073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.978527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.986227 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-368ef56b-3d3b-4584-8a6b-c757fc7f9700 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.163536 Oct 02 00:58:00.986794 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 111/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:00 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:01.360974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87cf6a8-250f-4968-b180-59047465dc6b", "tag": "44436467-0554-4f1d-acde-157873442d8d"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:01.376680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:01.377438 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:01.378214 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:01.392669 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] Creating event network-changed:44436467-0554-4f1d-acde-157873442d8d for instance c87cf6a8-250f-4968-b180-59047465dc6b on hv-cinder-maste Oct 02 00:58:01.397791 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-85cfa1d8-6aa1-4288-b795-a74457066336 req-0cabd24c-a938-4ccd-a430-ee080ab21262 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041398 Oct 02 00:58:01.398706 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 114/225] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:58:01.683856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:01.684842 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:01.693535 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:01.694574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:01.695308 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:01.696189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:01.696968 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:01.697559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:01.940902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:01.949840 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-15c2452a-d739-4617-ab34-da4f828fa451 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.274548 Oct 02 00:58:01.950702 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 112/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:01 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:02.011779 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:02.013180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:02.022587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.023233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.023829 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.024823 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.025442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.026071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.197888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:02.208392 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-26182c7c-83d0-46b7-99e9-b33fe6e1be12 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.200881 Oct 02 00:58:02.209552 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 115/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:02 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:02.975165 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:02.975165 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:02.982035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.982517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.982943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.984132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.984581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.985032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:03.140898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:03.148534 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4f3d4923-7b23-44b5-9833-958233a49cd6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.177772 Oct 02 00:58:03.149132 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 113/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:02 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:03.234479 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:03.235214 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:03.241748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:03.242254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:03.242688 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:03.243481 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:03.243837 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:03.244256 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:03.383990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:03.392842 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ed7c5a01-fe15-4daa-bc57-ef3a55f5f148 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.163524 Oct 02 00:58:03.393654 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 116/229] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:03 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:04.175302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:04.175985 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:04.183206 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.183700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.184141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.184847 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.185327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.185753 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.336665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:04.345390 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-16ec9e5a-b9ae-42fd-97bd-c64357de4b9b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.175542 Oct 02 00:58:04.346069 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 114/230] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:04 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:04.421923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:04.422520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:04.428912 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:04.429441 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:04.429688 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.430256 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.430700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.431419 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.431852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.432363 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.437934 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.438433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.438877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.439707 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:04.440109 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:04.440544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:04.474437 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-69151fe8-0344-4192-8371-21551aa05d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/ips" status: 200 len: 152 microversion: 2.20 time: 0.049197 Oct 02 00:58:04.475291 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 115/231] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Oct 2 00:58:04 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:58:04.582069 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:04.593316 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e0e042cf-cbe5-442f-8582-4cc9aa80ab2d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.175775 Oct 02 00:58:04.594445 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 117/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:04 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:05.370900 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:05.371709 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:05.378370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.378858 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.379316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.379992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.380448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.380876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.513579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:05.521927 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-32ef647d-8280-4c6a-8737-5a0195faf96f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.154980 Oct 02 00:58:05.522502 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 116/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:05 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:05.618392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:05.619027 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:05.626680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.627095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.627538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.628247 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.628710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.629177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.778099 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:05.785903 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-aeeb2970-2255-4914-8a76-003aabf9cdce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.171572 Oct 02 00:58:05.786498 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 118/234] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:05 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:06.545656 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:06.546375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:06.553406 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.553950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.554378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.555067 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.555516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.555896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf6a8-250f-4968-b180-59047465dc6b", "name": "network-vif-plugged", "status": "completed", "tag": "44436467-0554-4f1d-acde-157873442d8d"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:06.556005 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.566639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.567550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.568209 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.585915 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] Creating event network-vif-plugged:44436467-0554-4f1d-acde-157873442d8d for instance c87cf6a8-250f-4968-b180-59047465dc6b on hv-cinder-maste Oct 02 00:58:06.591013 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-c4ca2935-0ad0-4683-9037-e4b4e420c078 req-10d4c6b2-8392-43bd-80e4-7242f9538fac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039411 Oct 02 00:58:06.592496 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 119/235] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:06.700887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:06.709453 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d16272d7-71ee-47e7-ab2a-fb4d1d511cb9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.167584 Oct 02 00:58:06.710050 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 117/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:06 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:06.819140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:06.821952 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:06.829166 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.829665 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.830103 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.830807 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.834540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.835009 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.889170 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:06.890825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:06.897560 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.898298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.898955 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.899869 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.900557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.901079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.926536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lazy-loading 'flavor' on Instance uuid 0328982f-0ac7-4f28-9aa1-a990a8ddb71f {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:06.996572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:07.011853 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-10212946-c31d-4ea9-9002-744b48f32a42 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.202579 Oct 02 00:58:07.018107 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 120/237] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:06 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:07.190114 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-750b5f30-8248-4e3f-859d-0e247f7be4ec tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/action" status: 202 len: 0 microversion: 2.20 time: 0.304615 Oct 02 00:58:07.190766 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 118/238] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 2 00:58:06 2022] POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:58:07.199794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:07.200835 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:07.208180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:07.208692 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:07.209255 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:07.210073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:07.210746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:07.211249 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:07.367477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:07.382424 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:07.384206 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:07.385572 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-dd5e4c09-ce54-4670-8e2a-c8c931129131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.190156 Oct 02 00:58:07.386223 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 121/239] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:07 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:07.734353 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:07.736261 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:07.745718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:07.746478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:07.746913 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:07.747798 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:07.748479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:07.749523 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:07.902495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:07.911414 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-cfc96d70-b56b-42bf-ab82-dbf8c07598c9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1312 microversion: 2.1 time: 0.182147 Oct 02 00:58:07.912025 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 119/240] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:07 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:08.037207 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:08.037814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:08.046196 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.047125 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.047265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.048417 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.049038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.049380 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.134076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:08.262453 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:08.302385 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=8 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:08.307834 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9896f549-ce92-40be-b08e-3fa20d5e23ba tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.275783 Oct 02 00:58:08.323125 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:08 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:08.377911 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1a17ca2-a097-46df-a45e-438d02fac1cf", "device": "/dev/sdb"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:08.381710 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:08.390376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.390898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.391466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.392248 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.392641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.393222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.424300 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:08.430513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:08.441121 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.442502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.443874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.445302 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.446099 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.446544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.465628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:08.674657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:08.686906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:08.688193 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:08.689680 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-578b79d9-0fe2-446f-bf91-d8abd8903d97 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.281136 Oct 02 00:58:08.691256 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 123/242] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:08 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:08.933863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:08.934495 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:08.963676 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.965561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.966367 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:08.970333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:08.973307 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:08.977831 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.219973 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e9f41892-c2fd-4869-bf61-a728872e1aa5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "POST /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845921 Oct 02 00:58:09.220650 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 120/243] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:58:08 2022] POST /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:09.229616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:09.243662 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8c93229e-367e-4e82-9ea9-eef8c41d4e1a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1495 microversion: 2.1 time: 0.311958 Oct 02 00:58:09.257742 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 124/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:08 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1495 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:09.337060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:09.338074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:09.361912 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.363085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.365081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.366111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.366830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.367935 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.625982 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:09.636055 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6f879314-b536-4106-9942-16f9a7bc7d0c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.303378 Oct 02 00:58:09.637257 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 121/245] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:09 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:09.727966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:09.729382 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:09.750318 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.751743 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.752035 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.753680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.754454 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.755158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.930244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:09.936843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:09.937844 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:09.942347 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:09.944114 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.944612 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.945079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.945949 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:09.946074 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:09.946743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:09.947418 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:09.947557 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6a1ad914-6544-4c99-b60f-35397c0391fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.228545 Oct 02 00:58:09.948644 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 125/246] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:09 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:09.974635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:58:09.991346 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:10.084431 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9a743ea3-12db-4c48-8bed-0b4785848158 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 204 len: 0 microversion: 2.1 time: 0.151524 Oct 02 00:58:10.085304 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 122/247] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:58:09 2022] DELETE /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:58:10.093688 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:10.094301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:10.100528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.101050 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.101492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:10.102408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.103152 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.103586 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:10.255477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:10.263983 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-10934ea0-d3fd-4c8a-af9c-3f3ae1667065 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1501 microversion: 2.1 time: 0.174346 Oct 02 00:58:10.265669 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 126/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:10 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:10.664274 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:10.665130 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:10.672157 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.672747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.673729 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:10.674032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.674489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.674929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:10.822989 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:10.832030 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e00d88c2-aeb1-4871-99bc-4671bbffd4f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.172070 Oct 02 00:58:10.833169 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 123/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:10 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:10.974174 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:10.975021 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:10.981024 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.981506 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.981932 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:10.982605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:10.983616 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:10.984041 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.131403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:11.139402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:11.140874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:11.142025 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-49e0a6d2-d653-4be5-8dbe-166645978f9e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.171815 Oct 02 00:58:11.142576 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 127/250] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:10 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:11.288530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:11.289180 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:11.295858 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.296529 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.296997 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.297673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.298127 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.298541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.435468 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:11.449057 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9f924a25-723d-40bb-8c6a-8fa54b8f522b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1501 microversion: 2.1 time: 0.164229 Oct 02 00:58:11.449645 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 124/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:11 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:11.491958 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:11.493065 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:11.500785 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.501512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.502101 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.502976 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.503437 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.503871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.528640 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-25bbce15-99f8-479c-b5c9-47ea3eed6524 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/ips" status: 200 len: 147 microversion: 2.1 time: 0.040882 Oct 02 00:58:11.534889 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 00:58:11 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:11.863197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:11.864400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:11.874403 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.875370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.875970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:11.876769 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:11.877374 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:11.877875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.063884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:12.074581 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5ca875df-820a-45e5-ad05-94179e1e2326 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.215277 Oct 02 00:58:12.075537 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 125/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:11 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:12.166811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:12.167638 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:12.174777 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.175467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.176002 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.176760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.177351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.177806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.309974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:12.319053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:12.320746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:12.322151 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a5f2aa21-327f-46e6-bee1-9ea5cebea290 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.159254 Oct 02 00:58:12.322794 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 129/254] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:12 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:12.474548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:12.475585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:12.481850 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.482358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.482799 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.483683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.484132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.484584 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.659627 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:12.667733 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6d388b86-7d9f-4656-86fe-ca5ec21376b4 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1501 microversion: 2.1 time: 0.196975 Oct 02 00:58:12.668221 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 126/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:12 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:13.098401 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:13.099309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:13.106366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.107180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.107846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.108927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.109663 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.110366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.284461 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.318298 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e6b6bec0-c5b6-464d-834a-f345ee7f96d9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.224005 Oct 02 00:58:13.324054 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:13 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:13.354191 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:13.355833 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:13.365617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.366218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.366814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.367516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.368158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.369093 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.543377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.554816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.556275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.557499 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0f042a21-057f-41b1-8232-7692c7e9d916 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.212936 Oct 02 00:58:13.568217 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 127/257] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:13 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:13.692197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:13.692799 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:13.700291 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.702423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.703141 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.704115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.704792 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.705829 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.832878 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.842242 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2812b693-90b1-478b-b431-e1505a568f3b tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1459 microversion: 2.1 time: 0.153622 Oct 02 00:58:13.842830 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 131/258] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:13 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:13.846524 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87cf6a8-250f-4968-b180-59047465dc6b", "name": "network-vif-deleted", "tag": "44436467-0554-4f1d-acde-157873442d8d"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:13.856970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.857786 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.858563 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.871316 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] Creating event network-vif-deleted:44436467-0554-4f1d-acde-157873442d8d for instance c87cf6a8-250f-4968-b180-59047465dc6b on hv-cinder-maste Oct 02 00:58:13.877948 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-e7a4dd9b-9973-458a-ae35-d1d7651acbc8 req-e9d951cb-d385-4c32-8251-ba922916a923 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Oct 02 00:58:13.878796 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 128/259] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:58:14.350713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:14.351474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:14.358354 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.359182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.359711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.360432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.360892 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.361343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.444692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "722b2a9d-6d7a-4ff1-b0ed-c2ae1983ab46"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:14.447145 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:14.453669 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.454159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.454590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.455537 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.455950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.456533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.506794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:14.517081 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-71cd292f-e74b-406c-9f91-8b76d00375f2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.169309 Oct 02 00:58:14.518657 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 132/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:14 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:14.588928 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:14.589731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:14.596775 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.597293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.597728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.598524 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.598981 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.599402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.749245 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:14.758405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:14.759851 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:14.761023 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1d14be0e-7bf2-4bd7-a426-555f3c6e6508 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.177359 Oct 02 00:58:14.761572 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 133/261] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:14 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:14.878346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e1a17ca2-a097-46df-a45e-438d02fac1cf", "create_info": {"type": "qcow2", "new_file": "volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.000dca26-3c23-4de5-a4e3-8c78b8eb7c6f.vhdx", "snapshot_id": "000dca26-3c23-4de5-a4e3-8c78b8eb7c6f"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:14.886898 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=120760) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 02 00:58:14.888027 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.888508 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.888952 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.932546 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.933092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.933533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.961912 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-97c2535e-f3b0-476f-a83d-ba9fa1c76ed9 req-5638d014-766b-4897-8518-5cdfebdca096 admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.199106 Oct 02 00:58:14.962594 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 134/262] 10.222.0.36 () {64 vars in 1326 bytes} [Sun Oct 2 00:58:14 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:58:14.968019 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:14.968983 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:14.975420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.975948 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.976383 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.977174 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.978098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.978098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.016907 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.017768 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.018359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.019037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lazy-loading 'fault' on Instance uuid c87cf6a8-250f-4968-b180-59047465dc6b {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:15.075841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:15.085403 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4c09c928-ae2f-42da-b0c0-002614ccc305 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 200 len: 1302 microversion: 2.1 time: 0.121489 Oct 02 00:58:15.096977 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:14 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:15.161904 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6c0a34df-ea21-4815-9fd9-04cd7e7ad6ac tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721990 Oct 02 00:58:15.162726 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 129/264] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:58:14 2022] POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:58:15.543499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:15.544013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:15.550614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.551100 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.551536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.552229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.552687 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.553144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.714047 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:15.725100 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cef14d15-91e2-4afd-803c-f1ab49b7876d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.185375 Oct 02 00:58:15.737392 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 136/265] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:15 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:15.787330 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:15.788194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:15.794685 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.795980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.796504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.797204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.797731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.798327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.996237 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:16.006012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:16.007699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:16.008954 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fc09731f-3770-4d61-8424-f7276eb7dba3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.226390 Oct 02 00:58:16.009562 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 130/266] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:15 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:16.112523 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:16.113190 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: c87cf6a8-250f-4968-b180-59047465dc6b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:16.119570 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.120059 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.120498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.121488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.121947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.122374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.136419 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] HTTP exception thrown: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Request method failure captured: Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b HTTP/1.1 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOITy-UZRJ5Bgtu4w7OxkUz0Fyfc-tjWmMtFSoZRqI0wnchlokuhqwLZkHH04JEAyfBenlkARGMUnIzm-mkr0ELGyKXJ6yUfoa9Ws-SZeebPaskWB_qkKeXqBqfkWTwdNkoQPU6_dONgJZ537AEkoRSzYfMuqT6SxN789lha5gOGvrE Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: f7ef11453bfe47d7a1e8a8ec84144362 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:58:16.138134 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: f7ef11453bfe47d7a1e8a8ec84144362 Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesActionsTest-1053139794-project Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 5aa9341fc87840bc99378f1def51167b Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesActionsTest-1053139794-project Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. Oct 02 00:58:16.139557 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'c87cf6a8-250f-4968-b180-59047465dc6b'} Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:58:16.140303 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. Oct 02 00:58:16.141682 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:16.147247 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Returning 404 to user: Instance c87cf6a8-250f-4968-b180-59047465dc6b could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:58:16.147247 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f887d02d-f19f-4327-b685-4eb08609b0d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b" status: 404 len: 111 microversion: 2.1 time: 0.032183 Oct 02 00:58:16.147247 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 137/267] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:16 2022] GET /compute/v2.1/servers/c87cf6a8-250f-4968-b180-59047465dc6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 00:58:16.254553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1016073046", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "d3fad2df-2530-43f6-a4bf-529ca0895c27"}]}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:16.316967 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] validate_networks() for [('d3fad2df-2530-43f6-a4bf-529ca0895c27', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:58:16.734766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:58:16.735219 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:58:16.735697 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:58:16.736110 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:58:16.736528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:58:16.747805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.748974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.749452 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.750156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.750676 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.751201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.755065 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:16.756333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:16.763381 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.764488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.766121 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.766121 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.766323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.767105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.772474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Getting quotas for project f7ef11453bfe47d7a1e8a8ec84144362. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:58:16.777454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Getting quotas for user 5aa9341fc87840bc99378f1def51167b and project f7ef11453bfe47d7a1e8a8ec84144362. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:58:16.791079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:58:16.793500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:58:16.847752 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1d63e5d6-8b60-487e-9504-9df88814317f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597642 Oct 02 00:58:16.848522 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 131/268] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:58:16.860623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-db0157f5-4cb0-4112-80db-8aebf4e8672c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:16.861329 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-db0157f5-4cb0-4112-80db-8aebf4e8672c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:16.943434 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-db0157f5-4cb0-4112-80db-8aebf4e8672c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:16.956482 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-db0157f5-4cb0-4112-80db-8aebf4e8672c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1214 microversion: 2.1 time: 0.100018 Oct 02 00:58:16.957868 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 132/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:16 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:16.963088 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:16.973058 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2b383425-720c-4285-ba6d-d6d864bb9101 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.226960 Oct 02 00:58:16.973644 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 138/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:16 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:17.043082 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:17.044569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:17.060070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:17.060570 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:17.061657 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:17.062593 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:17.063234 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:17.063856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:17.275931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:17.287081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:17.289075 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:17.291401 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a0eca8ab-cfe9-4d09-9657-7aedf0295435 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.258819 Oct 02 00:58:17.292496 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 133/271] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:17 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:17.979876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:17.980485 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:17.988458 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:17.989006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:17.989525 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:17.990182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:17.990619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:17.991051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.001724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:18.002975 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:18.011838 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.013201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.014364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.015687 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.016362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.017285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.092411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.101386 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-db1322ed-028c-4c25-8710-fc27d7cf51ed tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1210 microversion: 2.1 time: 0.125107 Oct 02 00:58:18.101761 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 139/272] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:17 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:18.250755 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.271053 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a58b1a4f-8bee-4626-8920-fe616fc7614c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.274506 Oct 02 00:58:18.271617 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:17 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:18.324840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:18.325968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:18.339431 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.340315 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.341067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.342158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.343824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.344461 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.594316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:18.634900 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.636453 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.637839 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.681585 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.691624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.702483 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.703743 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f9ba9905-9729-4f8e-ad90-8a999a991f72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.384285 Oct 02 00:58:18.707268 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 140/274] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:18 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:18.794240 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Going to try to stop instance {{(pid=120759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 00:58:18.861853 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fab26112-9481-4cbc-8aea-6780890191dc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action" status: 202 len: 0 microversion: 2.1 time: 0.274944 Oct 02 00:58:18.862853 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 135/275] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:18 2022] POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:18.875308 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:18.876019 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:18.897974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.901096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.901966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.903968 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.905996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.906614 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.999203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e1a17ca2-a097-46df-a45e-438d02fac1cf", "create_info": {"type": "qcow2", "new_file": "volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.8672435d-1ef6-462e-910e-5f06d10d1cb1.vhdx", "snapshot_id": "8672435d-1ef6-462e-910e-5f06d10d1cb1"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:19.005215 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.006646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.008204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.021090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.021585 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.022450 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.026512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:19.044789 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-9679ac0b-cf86-42b9-ab78-3ec272d36b99 req-a2d0852e-c1b6-4fe0-93da-7c951025e982 admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.270225 Oct 02 00:58:19.046308 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 141/276] 10.222.0.36 () {64 vars in 1326 bytes} [Sun Oct 2 00:58:18 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 00:58:19.109779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:19.123882 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e674e4e1-ac6b-4d73-b677-e2dc6d2b4c6d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.254773 Oct 02 00:58:19.129879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:19.130967 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:19.137538 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 136/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:18 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:19.141934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.142877 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.143399 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.146686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.147700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.148562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.253223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:19.267394 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-97a0beaf-453d-4214-9d73-5f0f8bdd31c7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1266 microversion: 2.1 time: 0.143871 Oct 02 00:58:19.268399 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:19 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:19.305084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:19.306194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:19.318406 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.319073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.319364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.320811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.321476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.322073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.545027 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:19.554221 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b817c622-97c4-4252-953b-5fb337906d8c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.259766 Oct 02 00:58:19.555092 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 137/279] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:19 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:19.735478 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:19.736087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:19.743998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.744490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.744922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.745652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.746362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.746964 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.066330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.076459 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.077982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.079277 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4e18f0c5-d252-4640-8337-67ce09e31f95 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.347771 Oct 02 00:58:20.079851 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 143/280] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:19 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:20.149738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:20.150360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:20.156765 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.157293 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.157733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.158433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.158902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.159327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.163472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:20.294645 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:20.296053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:20.297479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.303195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.303686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.304121 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.304811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.305287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.305708 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.306334 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-352be36c-9544-44dc-abf0-4d74e55a8e3c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.160444 Oct 02 00:58:20.306925 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 138/281] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:20 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:20.374181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.382878 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-18219019-85bd-4dbc-8cdc-98dae149801a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1266 microversion: 2.1 time: 0.092144 Oct 02 00:58:20.383605 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:20 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:20.580554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:20.581496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:20.589043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.589956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.590789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.591779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.592786 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.593688 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.747468 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.757291 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-70e1ac98-85fb-4f5e-81eb-b49304bfae1e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.183559 Oct 02 00:58:20.758077 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 139/283] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:20 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:21.103732 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:21.104340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:21.111196 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.111685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.112134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.112833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.113315 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.113742 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.266375 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.274822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.276284 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.277493 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7271f6ca-e829-41fd-8062-65ca31b05152 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.177718 Oct 02 00:58:21.278245 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 145/284] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:21 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:21.330718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:21.331336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:21.337931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.338427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.338866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.339574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.340032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.340463 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.408562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:21.409470 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:21.418409 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.419134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.419969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.421548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.422244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.422871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.505012 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.508877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.514320 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-23a5f664-3d19-4107-ae48-33dfe74f0e2a tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1274 microversion: 2.1 time: 0.111324 Oct 02 00:58:21.514985 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 146/285] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:21 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:21.519094 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-84e4229e-3781-41f9-8bcb-015d54aae8f5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.192160 Oct 02 00:58:21.519813 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 140/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:21 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:21.782457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:21.783168 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:21.790577 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.791443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.792106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.793095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.793780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.794651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.995781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.009014 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-489d13e9-e2d0-4646-9449-ae1b558f1ef2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.231574 Oct 02 00:58:22.009592 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 147/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:21 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:22.305680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:22.306291 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:22.313162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.313652 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.314103 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.314791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.315236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.315677 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.502336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.510550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.512003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.513206 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8af78efe-a96d-40af-9682-122785996124 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.211457 Oct 02 00:58:22.513943 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 141/288] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:22 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:22.543230 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:22.544377 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:22.552852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:22.553501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:22.562248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.562741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.563258 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.564020 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.564324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.564457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.564878 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.565006 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.565392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.566095 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.566559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.566993 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.672973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.681324 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a2e6a4b0-ed23-475c-9f3f-800ea296eed1 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1272 microversion: 2.1 time: 0.142863 Oct 02 00:58:22.681896 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 148/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:22 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:22.825617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.845998 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9aa4b68a-c5fd-4d1e-afae-a717d3dc73c9 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.293839 Oct 02 00:58:22.846645 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 142/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:22 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:23.035814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:23.036441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:23.042789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.043293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.043747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.044631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.047816 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.048601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.350758 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:23.363154 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6e85e807-1430-49da-a1ab-d826bd9ded2c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.333107 Oct 02 00:58:23.364053 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 149/291] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:23 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:23.433107 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e1a17ca2-a097-46df-a45e-438d02fac1cf", "create_info": {"type": "qcow2", "new_file": "volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.9fd82684-bc16-4e71-9075-d2e4b30a5307.vhdx", "snapshot_id": "9fd82684-bc16-4e71-9075-d2e4b30a5307"}}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:23.445031 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92ecf1a6-18c4-4177-88e4-8ad45652d4a0(cell1) {{(pid=120759) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 02 00:58:23.445510 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.446070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.462243 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.513265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.514845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.515877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.538996 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-896297aa-03ab-4977-a11b-ae28d6cd946c req-4a49feea-a35a-4db7-8595-433678102d33 admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.318211 Oct 02 00:58:23.539617 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 143/292] 10.222.0.36 () {64 vars in 1326 bytes} [Sun Oct 2 00:58:23 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:58:23.540146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:23.541101 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:23.544283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:23.549800 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.550451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.550928 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.551660 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.552111 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.552533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.706789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:23.708086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:23.715714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.716352 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.716836 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.717648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.718173 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.718832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.072572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.082001 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.084034 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.085546 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9f6a9fce-e08b-4bec-9cad-1930a8fed3e3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1746 microversion: 2.20 time: 0.549740 Oct 02 00:58:24.086650 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 150/293] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:23 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1746 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:24.092295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:24.093233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:24.100164 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.100662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.101127 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.101831 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.102298 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.102721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.111673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.124995 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ffaab80a-bb95-4ccd-a708-3bb0365b92fc tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.423913 Oct 02 00:58:24.125585 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 144/294] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:23 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:24.345717 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.365347 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b49ca0b0-65cf-4e40-843b-ce2fa85d0692 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.277053 Oct 02 00:58:24.366161 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 151/295] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:24 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:24.390783 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:24.391084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:24.398248 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.399138 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.399868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.400843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.401605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.402284 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.633948 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.645933 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d95ffc7c-1887-446e-a008-d9178a95421a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1502 microversion: 2.1 time: 0.259984 Oct 02 00:58:24.647012 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:24 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:24.674737 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8642b3c-69d1-4b62-bb7a-3fb7b3005e26"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:24.677978 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:24.685076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.686502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.686960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.687699 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.688172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.688602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.715316 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] HTTP exception thrown: Cannot 'attach_volume' instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f while it is in vm_state rescued Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Request method failure captured: Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/os-volume_attachments HTTP/1.1 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 74 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG8oLRz9jQZMWUi8Kdnwv3QgotX_aLoQACbtOheDunN-3i3-s-XstUJh3zLwmpGowgsqMafEHEhz4FbJhSX6XGwhCQVWESS3GGCthrXQwwZlX0MtUxZDGvsBDTK7OZtI1vIRdNp7EUPvLpRp_9dUBKhvI9crsVZ-Gz9hrf116a1Bm8 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 00:58:24.717752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 5ff136440ace420997181fbf11999496 Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: {"volumeAttachment": {"volumeId": "e8642b3c-69d1-4b62-bb7a-3fb7b3005e26"}} Oct 02 00:58:24.719879 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Cannot 'attach_volume' instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f while it is in vm_state rescued Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'server_id': '8da7db91-0f99-4f2a-8d76-aa6544f7656f', 'body': {'volumeAttachment': {'volumeId': 'e8642b3c-69d1-4b62-bb7a-3fb7b3005e26'}}} Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:58:24.721271 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f while it is in vm_state rescued Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:24.722432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f while it is in vm_state rescued Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Returning 409 to user: Cannot 'attach_volume' instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f while it is in vm_state rescued {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-84517d74-cfc3-4587-9ded-6193403115e0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049304 Oct 02 00:58:24.724233 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 152/297] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:58:24 2022] POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 00:58:24.729616 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:24.730168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:24.737206 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.737845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.738549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.739495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.740318 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.741260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.762497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f7fdf39-964a-4921-8460-0bfcb26e14c7", "tag": "9ac23955-6c60-4f93-82de-133eba39dadb"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:24.790927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.791488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.791974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.805365 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] Creating event network-changed:9ac23955-6c60-4f93-82de-133eba39dadb for instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 on hv-cinder-maste Oct 02 00:58:24.820765 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-eb13e94e-2953-44af-a56d-81dc52140fdd req-958f5b33-f4fd-4f19-85cf-8371f9db2523 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054886 Oct 02 00:58:24.821611 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 153/298] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:24.832760 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2a01f8cb-1636-4a7a-8f6a-64be5f90438b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/action" status: 202 len: 0 microversion: 2.1 time: 0.107255 Oct 02 00:58:24.834131 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 146/299] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:24 2022] POST /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:24.847618 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:24.853023 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:24.860248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.860751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.861231 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.861942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:24.862402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:24.862834 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.029830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.038425 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bc7ec196-16c3-40f4-ab3e-76aa4d98e3ab tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1510 microversion: 2.1 time: 0.199582 Oct 02 00:58:25.039181 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 154/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:24 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:25.113111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:25.113817 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:25.120001 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.120487 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.121219 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.122347 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.122989 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.123413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.149374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:25.149978 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:25.168390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.168880 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.169443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.170632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.171086 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.171508 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.357242 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.366454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.368236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.369582 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5c2d84c1-4db6-49c2-b4c8-91c867c94164 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1746 microversion: 2.20 time: 0.260864 Oct 02 00:58:25.370427 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 147/301] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:25 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1746 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:25.381098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.391819 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:25.392619 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d1715acf-d6f8-4e2e-af34-2638feb4aadf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.247591 Oct 02 00:58:25.392745 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:25.393550 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 155/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:25 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:25.396553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:25.400322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.401104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.401549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.402255 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.402816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.403212 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.631285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.642365 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-631c1946-3520-416d-9977-0acaec118f2a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.257273 Oct 02 00:58:25.643007 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 148/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:25 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:26.063730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:26.064516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:26.071979 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.072475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.073082 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.073908 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.074247 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.074705 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.210322 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.218138 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5487fcba-7374-42ea-b5e8-967d2b67498f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1510 microversion: 2.1 time: 0.159603 Oct 02 00:58:26.218929 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 156/304] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:26 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:26.403370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:26.404297 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:26.413101 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.416002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.417463 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.419156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.420256 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.421113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.423017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:26.424046 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:26.432340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.433589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.434420 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.435995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.436727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.437437 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.868884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.870391 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.886305 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-54c98bf8-12ad-42d3-8bc2-a10ea4ffbcb7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.470472 Oct 02 00:58:26.887206 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.887426 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 157/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:26 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:26.890884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.892355 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-254941cd-7a5f-43f9-b623-390d1c655371 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1746 microversion: 2.20 time: 0.493196 Oct 02 00:58:26.899158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:26.900167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:26.906328 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 149/306] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:26 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1746 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:26.908274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.908879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.909474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.910257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.911311 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.911833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.098906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:27.111526 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d7548c51-e567-4266-854e-5fb57c77efd0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.221949 Oct 02 00:58:27.112194 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 158/307] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:26 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:27.243112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.244432 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.252563 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=8 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:27.254706 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.255494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.256288 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.257322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.258481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.259166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.425585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:27.434187 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-954c0423-c938-466e-b267-f52601ce7eae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1510 microversion: 2.1 time: 0.197346 Oct 02 00:58:27.453026 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 150/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:27 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:27.661944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.665199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.665682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.666115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.675097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.675581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.676020 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.690079 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-196a53dc-a9b8-40eb-9fa4-64722a4bef5b req-b140e209-3ba2-490e-8b06-1091b87a874a admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/000dca26-3c23-4de5-a4e3-8c78b8eb7c6f?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.000dca26-3c23-4de5-a4e3-8c78b8eb7c6f.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.337679 Oct 02 00:58:27.690658 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 159/309] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:58:27 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/000dca26-3c23-4de5-a4e3-8c78b8eb7c6f?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.000dca26-3c23-4de5-a4e3-8c78b8eb7c6f.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:58:27.910454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.911068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.917479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.917950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.918386 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.919091 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.919605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.920218 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.923452 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.925934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.930736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.931327 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.931845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.932630 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.933176 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.933738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.938956 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:28.191268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.199107 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2f02f623-a96f-48af-a891-99fed590f1f8 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.292516 Oct 02 00:58:28.199452 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.200052 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 151/310] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:27 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:28.217367 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:28.218183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:28.223800 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.224398 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:28.224901 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:28.225493 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.225652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.226152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:28.226677 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fef4b05b-0be6-4d81-a310-4bd508f94fe6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1746 microversion: 2.20 time: 0.308324 Oct 02 00:58:28.226811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:28.227155 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.227565 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 160/311] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:27 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1746 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:28.399677 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.413918 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-38579ff2-8115-41e6-a6f9-7f0a9a5401ff tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.213052 Oct 02 00:58:28.414678 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 152/312] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:28 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:28.459373 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:28.459651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:28.466741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:28.467686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:28.468824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.469580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:28.470200 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:28.470950 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.619128 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "name": "network-vif-plugged", "status": "completed", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:28.635162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:28.635725 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:28.636362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.649109 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] Creating event network-vif-plugged:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:58:28.652432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.655747 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-0d9f7010-1bad-482d-a7a7-2bdd622d915f req-32d791bd-c110-45cf-9d99-eb25174df235 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044004 Oct 02 00:58:28.656819 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 153/313] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:28.662719 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b3cae27e-c9bf-4fe3-9715-c940bf20fceb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1510 microversion: 2.1 time: 0.207825 Oct 02 00:58:28.663292 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 161/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:28 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:29.226864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:29.227737 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:29.235626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.236125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.236568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.237307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.237768 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.238198 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.256592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:29.257887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:29.264339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.264832 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.265611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.266511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.267128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.267712 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.462450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.467326 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.471713 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fc17b944-78c7-4c3e-ad35-0796b37247c3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.249295 Oct 02 00:58:29.472363 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 154/315] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:29 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:29.477993 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:29.478782 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:29.486544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.487535 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.488117 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.489003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.489592 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.490158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.491904 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.493421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.494611 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4a269911-e410-40b6-9ab5-2f27c282845d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1746 microversion: 2.20 time: 0.242235 Oct 02 00:58:29.494744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:29.504998 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 162/316] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:29 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1746 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:29.638964 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.647815 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a0830afd-df0c-4008-8dca-b9ef580923a3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.173692 Oct 02 00:58:29.648377 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 155/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:29 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:29.690538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:29.691249 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:29.697180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.697814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.698340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.698951 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.699416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.699986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.853709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.869587 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5f4b5a82-fbcd-40e1-99e9-ced9c35277e7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1510 microversion: 2.1 time: 0.182783 Oct 02 00:58:29.870185 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 163/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:29 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:30.498504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:30.499249 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:30.506006 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.506588 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.507268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.508113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.508847 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.509345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.522062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:30.522679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:30.529103 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.529596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.530536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.530789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.531496 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.531852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.739108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.746817 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.751467 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fc3e641e-342a-430e-80b6-b5419bd3acaf tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.257075 Oct 02 00:58:30.752141 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 156/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:30 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:30.757717 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:30.758730 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:30.764530 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.766702 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.768086 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-745d6c37-140e-4299-bffc-a9fe2cd37b47 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.250099 Oct 02 00:58:30.771650 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.772188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.772635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.773407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.773539 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 164/320] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:30 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:30.774165 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.774760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.898135 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:30.898800 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:30.906093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.906629 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.907073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.907887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.908349 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.908778 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.938733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.951731 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aab4ef6d-e8ce-4144-97b3-b38e5886010d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.197965 Oct 02 00:58:30.952573 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 157/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:30 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:31.078503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:31.087106 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7dd30d96-c498-43fc-8c32-4de4625527a6 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1516 microversion: 2.1 time: 0.193483 Oct 02 00:58:31.087691 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 165/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:30 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:31.777450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:31.778058 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:31.784712 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.785294 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.785668 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.790077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.790576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.790990 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.796566 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:31.797373 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:31.803677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.804170 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.805813 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.806862 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.807477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.808066 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:32.027673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:32.031369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:32.037786 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3edafcbd-02d2-49ec-8ea8-7ea3e849b5d6 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.264079 Oct 02 00:58:32.039084 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 158/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:31 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:32.040067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:32.041558 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:32.042723 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6eb99ea8-474c-420c-8ddd-ec8e21d4e855 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.251790 Oct 02 00:58:32.043269 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 166/324] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:31 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:32.045595 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:32.046585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:32.052860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:32.053723 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:32.054407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:32.055103 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:32.055557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:32.055976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:32.226549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:32.240851 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-62587016-b6af-4098-a182-0bd4d0f89762 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.200043 Oct 02 00:58:32.243146 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 159/325] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:32 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:32.484262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-743d5495-1fa7-4b70-b0d7-946ea6b2dabf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: .version_select at 0x7feb049ae820>, body: {"keypair": {"name": "tempest-keypair-1693068305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuqFCfNttZMV+l2veOD0K8fWXcDLikoaM7WZOM/4s1401BdP7lObNPNYk5N/T1ulUpqLEN27h1Rn2qAnv1k3jb3jkskZEwPkDzfrafK7H0Cd8OdGDsxtaA7AJMdH7Lvrw=="}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:32.504243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-743d5495-1fa7-4b70-b0d7-946ea6b2dabf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:58:32.508003 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-743d5495-1fa7-4b70-b0d7-946ea6b2dabf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for user 5ff136440ace420997181fbf11999496 and project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:58:32.545709 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-743d5495-1fa7-4b70-b0d7-946ea6b2dabf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065207 Oct 02 00:58:32.546318 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 167/326] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 00:58:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:33.062528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:33.063436 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:33.070029 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:33.070646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:33.073800 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.074430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.075554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.076373 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.077159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.077652 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.081109 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.081601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.082204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.083182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.083634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.084210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.504928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=4 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:33.579137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:33.588469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:33.589942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:33.591615 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c431e25b-9a69-4a0c-89d4-9109d238c66a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.525636 Oct 02 00:58:33.592177 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 168/327] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:33 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:33.596633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:33.597257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:33.603522 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.603942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.604384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.605119 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:33.605740 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:33.606314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:33.610757 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:33.618991 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-22730444-714d-4949-9928-abb40a2936d3 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.560840 Oct 02 00:58:33.619579 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 160/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:33 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:33.870451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:33.884743 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fc4338d0-bebf-4d6a-b979-eef17658f325 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.291517 Oct 02 00:58:33.885457 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 169/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:33 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:34.508052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-895339508", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2b0268-d76d-48d0-9319-e95162e09f4e"}], "security_groups": [{"name": "tempest-securitygroup--1116508632"}], "key_name": "tempest-keypair-1693068305", "user_data": "}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:34.626577 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:34.627588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:34.633934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.634507 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.635149 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.635847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.636301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.636726 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.771223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:34.780374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:34.781875 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:34.783066 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2164844b-8ad7-4973-b1cb-1758845f27ef tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.160809 Oct 02 00:58:34.783625 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 170/330] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:34 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:34.906279 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:34.909669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.910163 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.910603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.918908 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.920714 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.921898 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.940041 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-0a0744df-8800-400f-8b34-3ca6360dd5b8 req-1aa7799b-1f70-47e9-a04b-bea07a20ce26 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/9fd82684-bc16-4e71-9075-d2e4b30a5307?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.9fd82684-bc16-4e71-9075-d2e4b30a5307.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.155136 Oct 02 00:58:34.940624 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 171/331] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:58:34 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/9fd82684-bc16-4e71-9075-d2e4b30a5307?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.9fd82684-bc16-4e71-9075-d2e4b30a5307.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:58:34.946011 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:34.946825 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:34.954709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.955066 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.955503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.956204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.956659 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.957122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.102350 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:35.110269 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bc6b5776-f6df-4a50-9c46-7f5f7a7ae2f9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.168228 Oct 02 00:58:35.110869 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 172/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:34 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:35.117477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7fdf39-964a-4921-8460-0bfcb26e14c7", "name": "network-vif-plugged", "status": "completed", "tag": "9ac23955-6c60-4f93-82de-133eba39dadb"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:35.128512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:35.129017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:35.129455 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.141721 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] Creating event network-vif-plugged:9ac23955-6c60-4f93-82de-133eba39dadb for instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 on hv-cinder-maste Oct 02 00:58:35.146665 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-14cf35ca-b229-4d5d-acd9-d58eb2409887 req-d1107cd9-b6b0-4893-80b8-c4ed01b06379 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034670 Oct 02 00:58:35.147259 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 173/333] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:35.152492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:35.153285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:35.160426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:35.160956 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:35.161484 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.162203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:35.162664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:35.163107 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.303115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:35.312292 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-54a566f0-1320-402a-99ac-7d4b9d8a4ec4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1725 microversion: 2.1 time: 0.163894 Oct 02 00:58:35.312855 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 174/334] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:35 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:35.808729 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:35.809431 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:35.815784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:35.816281 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:35.816727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.817470 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:35.817934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:35.818362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:35.967271 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:35.984159 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:35.984159 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:35.985239 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fcea935a-871a-46aa-a274-8be21cad6b8c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.180136 Oct 02 00:58:35.986574 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 175/335] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:35 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:36.135107 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:36.135669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:36.142512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.142996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.143590 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.144280 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.145070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.145501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.290723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:36.299223 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3b73fbcf-63eb-4d80-8464-fa92b35ab1b9 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.168237 Oct 02 00:58:36.299859 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 176/336] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:36 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:36.337167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:36.337896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:36.344622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.345153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.345592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.346307 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.346761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.347187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.496903 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:36.506655 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6b7d483d-fcea-4a99-9bc4-c9fb64047884 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1702 microversion: 2.1 time: 0.173928 Oct 02 00:58:36.508104 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 177/337] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:36 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1702 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:36.532001 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:36.540047 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.540544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.541156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.603845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Going to try to start instance {{(pid=120760) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 00:58:36.621467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:36.650346 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4adce4bd-6c79-4390-a598-5ab2a9131d08 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action" status: 202 len: 0 microversion: 2.1 time: 0.122763 Oct 02 00:58:36.650948 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 178/338] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:36 2022] POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 00:58:36.659115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:36.659808 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:36.665947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.666441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.666907 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.667600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:36.668061 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:36.668546 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:36.804992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:36.814119 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-044345b0-0389-407b-b080-3b5d7286a7e7 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.158957 Oct 02 00:58:36.814740 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 179/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:36 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:37.011922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:37.012524 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:37.018679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.019229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.019670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:37.020563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.021433 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.022169 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:37.171436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:37.179874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:37.181445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:37.182643 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f32472fe-0abd-463f-b652-2168f98943e9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.174629 Oct 02 00:58:37.183201 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 180/340] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:37 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:37.323161 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:37.323769 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:37.332725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.333252 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.333697 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:37.334401 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.334862 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.335290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:37.496697 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:37.505983 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-58ff3c62-e834-474c-a499-0a9f51b5cd66 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.186620 Oct 02 00:58:37.507142 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 181/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:37 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:37.574232 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] validate_networks() for [('2d2b0268-d76d-48d0-9319-e95162e09f4e', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:58:37.838395 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:37.839060 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:37.846416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.847425 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.848103 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:37.849020 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:37.849631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:37.850297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.084421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:58:38.085158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:58:38.085814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:58:38.086489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:58:38.087086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:58:38.105543 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.106096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.107427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.108182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.108699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.111327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.142235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:58:38.148558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Getting quotas for user 5ff136440ace420997181fbf11999496 and project 9d154735aabe4f2b966f44f5d2ce92d6. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:58:38.149508 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.161710 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3943f5f6-ba4f-4d66-84fa-63a1757e1f56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.327312 Oct 02 00:58:38.162462 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 182/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:37 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:38.181640 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:58:38.184413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:58:38.210310 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:38.211201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:38.227528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.233308 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.234031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.235053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.235765 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.239738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.256239 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f83d28f9-2709-4618-9015-272da8949dc0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.752157 Oct 02 00:58:38.257437 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 161/343] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:58:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 3754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:58:38.271422 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-40d7a7af-ed00-4754-8522-7861af214fc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:38.272319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-40d7a7af-ed00-4754-8522-7861af214fc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:38.400848 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-40d7a7af-ed00-4754-8522-7861af214fc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.409134 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-40d7a7af-ed00-4754-8522-7861af214fc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1245 microversion: 2.1 time: 0.142896 Oct 02 00:58:38.414200 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 162/344] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:38 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:38.500550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.513396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.518458 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.519617 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b3c571f9-6607-4fb1-b493-37028bd1d665 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.313231 Oct 02 00:58:38.520540 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 183/345] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:38 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:38.530129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:38.530933 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:38.538880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.539613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.540238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.541156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:38.541766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:38.542841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:38.819162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:38.838534 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e2022d41-6c6c-477d-b6ba-ef1c8a438161 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1314 microversion: 2.1 time: 0.312735 Oct 02 00:58:38.841580 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 163/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:38 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:38.995736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:39.003896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.004518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.005270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.007859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=9 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:39.019122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.019722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.020358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.037293 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-e367418a-de94-40cb-86ff-a018f4e80e81 req-3e27ff93-a152-41ed-b0b6-c36be47f2090 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8672435d-1ef6-462e-910e-5f06d10d1cb1?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.8672435d-1ef6-462e-910e-5f06d10d1cb1.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.126181 Oct 02 00:58:39.039322 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 184/347] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:58:38 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8672435d-1ef6-462e-910e-5f06d10d1cb1?delete_info=%7B%22file_to_merge%22:%20%22volume-e1a17ca2-a097-46df-a45e-438d02fac1cf.8672435d-1ef6-462e-910e-5f06d10d1cb1.vhdx%22,%20%22volume_id%22:%20%22e1a17ca2-a097-46df-a45e-438d02fac1cf%22%7D => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:58:39.188496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:39.189421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:39.204535 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.205642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.206334 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.207696 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.208390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.209864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.390925 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:39.399708 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1b17d5eb-d995-4198-8980-e8a53c80977c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.215606 Oct 02 00:58:39.400278 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 164/348] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:39 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:39.442227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:39.449805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:39.468649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.469183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.469632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.472411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.472912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.473383 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.550518 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:39.551534 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:39.558751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.560152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.561278 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.562257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.562938 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.563659 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.572341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:39.581058 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7523d4c8-b0c0-4984-ac11-873d753abdae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1241 microversion: 2.1 time: 0.148306 Oct 02 00:58:39.581962 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 185/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:39 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:39.735236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:39.745318 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:39.747891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:39.750032 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ab9c2a06-24b4-40df-a169-b44ce358271a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.203631 Oct 02 00:58:39.751966 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 165/350] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:39 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:39.866330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:39.866953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:39.874622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.875436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.875564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:39.876259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:39.876722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:39.877178 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.040045 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:40.070950 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-14a6ab62-7a21-44a4-bc03-5f8dfbbec25e tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1497 microversion: 2.1 time: 0.210979 Oct 02 00:58:40.085260 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 186/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:39 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:40.426918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:40.428500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:40.438797 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.439302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.439744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.440661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.441298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.441917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.608856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:40.611135 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:40.619469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.619998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.620433 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.621588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.623533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.623533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.763582 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:40.790180 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f0d893e5-78ce-4468-92d0-38cd45033dcf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1297 microversion: 2.1 time: 0.186968 Oct 02 00:58:40.795479 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 187/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:40 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1297 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:40.800890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:40.816900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:40.817811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:40.823964 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-41e5fb91-c621-421f-ad8a-e4c1a746ad19 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.403228 Oct 02 00:58:40.826093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.826766 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.827350 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.828348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.828971 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.829641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.840856 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 166/353] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:40 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:40.899176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:40.899855 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:40.908229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.909356 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.910162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.911103 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:40.912129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:40.912764 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:40.944204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:58:41.047474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:41.058000 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:41.060839 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e20c566f-da69-4c9b-aaec-75100633c7a7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 204 len: 0 microversion: 2.1 time: 0.166135 Oct 02 00:58:41.062466 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:41.063391 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 167/354] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:58:40 2022] DELETE /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:58:41.067472 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0e86a94b-5ab1-4681-9e1c-8983c812a8bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.260316 Oct 02 00:58:41.072909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:41.073937 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 188/355] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:40 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:41.074739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:41.081579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.082172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.082802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.083478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.084008 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.084509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.261195 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:41.270068 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fe6a2f47-4940-4ad3-a338-831af1ac80aa tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1503 microversion: 2.1 time: 0.201153 Oct 02 00:58:41.284084 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 168/356] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:41 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:41.827997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:41.829217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:41.845849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.848588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.849722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.851846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.853357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.855171 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.861576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:41.862490 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:41.869090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.869589 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.870032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.871337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.871804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.872813 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.042471 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.083090 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b6e194be-3dd9-4dba-8807-a54ef65a6a3d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1297 microversion: 2.1 time: 0.259764 Oct 02 00:58:42.101803 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 189/357] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:41 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1297 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:42.123957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:42.124561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:42.131212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.131991 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.133089 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.134498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.135168 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.135666 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.151063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.160573 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d7d49bae-0e19-4cae-807b-7312a001e028 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.304950 Oct 02 00:58:42.165644 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 169/358] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:41 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:42.296731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:42.298130 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:42.312657 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.313654 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.314265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.315028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.317909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.318375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.322254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.334156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.336686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.338470 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7d337592-94ad-45b8-9888-6614c1bba609 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.222072 Oct 02 00:58:42.339060 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 190/359] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:42 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:42.510517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:42.521770 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-68a76a80-a88d-4f2b-aea8-0cb84a6a828d tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1503 microversion: 2.1 time: 0.229540 Oct 02 00:58:42.523458 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 170/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:42 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:43.107705 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:43.108355 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:43.117757 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=4 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:43.120287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.121459 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.122116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.123030 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.123498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.123931 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.198073 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:43.207418 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:43.222017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.222879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.223530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.224473 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.225301 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.225933 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.244756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.255004 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-06bb6636-9e59-4ac6-940c-59542e41383d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1297 microversion: 2.1 time: 0.151136 Oct 02 00:58:43.255839 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 191/361] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:43 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:43.368210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:43.369246 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:43.378517 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.379362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.380012 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.380925 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.381726 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.382398 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.450890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.455139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:43.462587 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-10b26c02-50dd-4141-a3bb-659b2b093d07 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1711 microversion: 2.1 time: 0.272805 Oct 02 00:58:43.463827 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 171/362] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:43 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1711 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:43.548725 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:43.549630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:43.556989 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.557773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.558379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.562603 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:43.563439 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:43.565384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.580770 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.599700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.601191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.602371 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bd449a6f-9eca-4310-9b3a-dd471572ebde tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.238439 Oct 02 00:58:43.602930 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 192/363] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:43 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:43.736429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.750192 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-32f9d18d-843b-48e7-8739-7d26ec4a528f tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1503 microversion: 2.1 time: 0.205427 Oct 02 00:58:43.751195 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 172/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:43 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:44.282026 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.283364 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.294551 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.295050 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.295489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.296202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.296662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.308105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.399183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:44.413979 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5cae271b-15ac-4469-9cb3-59c50903ca14 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1297 microversion: 2.1 time: 0.133494 Oct 02 00:58:44.414967 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 193/365] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:44.491929 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.492640 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.502016 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.502973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.503582 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.504527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.505367 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.505971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.635885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.636622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.645240 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.649426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.650274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.651256 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.651963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.652620 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.731546 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:44.744193 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5cbe445f-7af9-4944-be75-9cee91a357d5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1715 microversion: 2.1 time: 0.256263 Oct 02 00:58:44.746339 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 173/366] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1715 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:44.793669 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.795174 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.807134 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.810132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.810917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.812883 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.813663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.814703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.984368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.042078 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.044129 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.050399 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1b90306d-b6e2-47d9-b0b4-30b4d7cca342 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.419033 Oct 02 00:58:45.053578 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 194/367] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:45.122473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7fdf39-964a-4921-8460-0bfcb26e14c7", "name": "network-vif-deleted", "tag": "9ac23955-6c60-4f93-82de-133eba39dadb"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:45.143683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.143683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.143683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.173289 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] Creating event network-vif-deleted:9ac23955-6c60-4f93-82de-133eba39dadb for instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 on hv-cinder-maste Oct 02 00:58:45.188370 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-535844ce-61ca-410b-a49c-05332a80198a req-5e7f0d35-638f-4854-b347-19d416d4ec19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069241 Oct 02 00:58:45.189107 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 195/368] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:45.202599 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.204280 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:45.211711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.212210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.229474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.230295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.230785 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.231923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.268928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.281942 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3d8aad4c-af44-46c0-9087-9cd167d7e5e7 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1503 microversion: 2.1 time: 0.493971 Oct 02 00:58:45.282910 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 174/369] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:45.286248 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:45.457804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.458976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:45.479249 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.479758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.483626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.484887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.487076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.498636 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.528676 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lazy-loading 'services' on Instance uuid b85428c9-8c3d-40b5-b776-b6d8770c19ae {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:45.656729 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.668042 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4cf0d544-6886-454e-99e7-e9b8a89ad993 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1303 microversion: 2.1 time: 0.223728 Oct 02 00:58:45.682626 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 175/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:45 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:45.694966 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-64a4c403-7b38-4a5e-a968-ed7c0d9eef07 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae/os-volume_attachments/e1a17ca2-a097-46df-a45e-438d02fac1cf" status: 202 len: 0 microversion: 2.1 time: 0.502075 Oct 02 00:58:45.695561 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 196/371] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 00:58:45 2022] DELETE /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae/os-volume_attachments/e1a17ca2-a097-46df-a45e-438d02fac1cf => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:46.081573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.082695 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.089376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.090011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.090682 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.091597 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.092172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.092702 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.299388 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.307575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.311547 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.313120 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.319060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.320348 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a36f4aa1-90e7-4403-b223-e5a7d04c2eb0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.243049 Oct 02 00:58:46.320962 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 176/372] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:46.336879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.336879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.336879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.336879 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.337304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.337304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.476752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:46.478603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.479239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.479757 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.480282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lazy-loading 'fault' on Instance uuid 4f7fdf39-964a-4921-8460-0bfcb26e14c7 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:46.571644 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa9341fc87840bc99378f1def51167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ef11453bfe47d7a1e8a8ec84144362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.582790 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d022c847-8f3a-4a53-af2d-75cd425b7360 tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 200 len: 1304 microversion: 2.1 time: 0.276699 Oct 02 00:58:46.584677 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 197/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:46.694412 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.695838 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.708447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.709289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.710072 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.711744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.712539 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.713186 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.953818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.966038 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5c4294ef-5a20-4a0c-ae9e-a2490e32d345 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.275038 Oct 02 00:58:46.967061 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 177/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:47.355997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.357781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:47.368215 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.369203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.369918 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.371287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.372793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.373733 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.618580 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.619653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] [instance: 4f7fdf39-964a-4921-8460-0bfcb26e14c7] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:47.628459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.629268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.629891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.630970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.631935 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.632698 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.657276 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] HTTP exception thrown: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Request method failure captured: Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 HTTP/1.1 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOITy-UZRJ5Bgtu4w7OxkUz0Fyfc-tjWmMtFSoZRqI0wnchlokuhqwLZkHH04JEAyfBenlkARGMUnIzm-mkr0ELGyKXJ6yUfoa9Ws-SZeebPaskWB_qkKeXqBqfkWTwdNkoQPU6_dONgJZ537AEkoRSzYfMuqT6SxN789lha5gOGvrE Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: f7ef11453bfe47d7a1e8a8ec84144362 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:58:47.662552 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ef11453bfe47d7a1e8a8ec84144362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: f7ef11453bfe47d7a1e8a8ec84144362 Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesActionsTest-1053139794 Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesActionsTest-1053139794-project Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 5aa9341fc87840bc99378f1def51167b Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesActionsTest-1053139794-project Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. Oct 02 00:58:47.664250 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '4f7fdf39-964a-4921-8460-0bfcb26e14c7'} Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:58:47.665150 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. Oct 02 00:58:47.666589 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:58:47.670802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] Returning 404 to user: Instance 4f7fdf39-964a-4921-8460-0bfcb26e14c7 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:58:47.671889 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d5a93711-b897-435a-803b-ca76bf8ecd5c tempest-VolumesActionsTest-1053139794 tempest-VolumesActionsTest-1053139794-project] 10.222.0.26 "GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7" status: 404 len: 111 microversion: 2.1 time: 0.063350 Oct 02 00:58:47.672923 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 178/375] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/servers/4f7fdf39-964a-4921-8460-0bfcb26e14c7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:58:47.856916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.867727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.876370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.878407 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c8c527f1-ecfe-4a11-acd9-ccb96080dfd3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.527201 Oct 02 00:58:47.878979 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 198/376] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:48.011494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:48.012171 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:48.020496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.021261 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.022046 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.023228 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.023853 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.024435 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.027498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:48.029348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:48.038056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.039335 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.040408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.041753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.042396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.043047 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.093619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:58:48.131786 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:48.326649 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-da8e69a0-794a-4900-8ace-a5ce216f0a31 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 204 len: 0 microversion: 2.1 time: 0.303686 Oct 02 00:58:48.332342 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 199/377] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:58:48 2022] DELETE /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:58:48.338927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:48.357613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.359015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.359780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.390358 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] Creating event network-changed:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 00:58:48.396338 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-3bec0d01-3b03-45e2-bb88-bc65a0a5ede4 req-e9eec292-1326-476c-9f90-794463531d38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061845 Oct 02 00:58:48.397267 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 200/378] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:48.402829 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:48.404736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:48.408892 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=8 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:48.412506 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.413263 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.413901 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.414848 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.415548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.416199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.435135 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.450869 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4bd7b23a-a941-4317-a72d-66b4bdc0c54f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.451261 Oct 02 00:58:48.452462 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 179/379] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:48.623188 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.632181 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-adc7b5bf-68ee-4425-bea5-01d5a4644aed tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.233465 Oct 02 00:58:48.632797 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 201/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:48 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:48.922688 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:48.925307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:48.939197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.940116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.940976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.942365 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.943213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.944011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.166587 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.176084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.177527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.178730 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6181a240-5f57-41a3-bd42-ff9fe4e1ec09 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.269199 Oct 02 00:58:49.179499 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 180/381] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:48 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:49.479861 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:49.480648 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:49.488696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:49.491316 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.492351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.493031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.493987 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.494622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.495062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.658444 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.659962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:49.660594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:49.667302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.667692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.668025 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-92b46954-4818-46b7-bf30-5ece5a5a82bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.192141 Oct 02 00:58:49.668139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.668663 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 202/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:49 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:49.670075 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.670204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.670538 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.843401 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.854599 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d3d1d319-5fb6-44b0-a987-c81c87f0d7f2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.198308 Oct 02 00:58:49.855291 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 181/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:49 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:50.209614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:50.210998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:50.221883 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.224359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.225107 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.226204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.226857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.227822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.399057 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.408599 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.410090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.411284 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a7d02fb3-4205-436c-b9f2-bbdf6612854e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.208420 Oct 02 00:58:50.411847 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 203/384] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:50 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:50.693971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:50.694587 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:50.702356 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.702846 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.703280 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.703988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.704474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.705066 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.882311 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:50.882934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:50.910935 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.917142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.921441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.927475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.932358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.939333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.144592 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.161802 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a35d77f0-ea25-4fe5-ab76-5a19e150f31d tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.472156 Oct 02 00:58:51.177399 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 182/385] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:50 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:51.271993 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.280819 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c85f3d8a-bd16-4fd2-a3e6-d48c00e8edff tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.402358 Oct 02 00:58:51.281638 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 204/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:50 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:51.438491 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:51.439446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:51.449676 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.451990 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.452607 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.454842 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.454842 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.454842 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.659898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.669534 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.671358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.672664 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e8ab4838-6c4d-45cf-b5d7-45268d762d72 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.238501 Oct 02 00:58:51.680226 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 183/387] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:51 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:52.193701 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:52.195087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:52.200874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.201414 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.201864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.202539 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.202995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.203415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.305061 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:52.306605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:52.317142 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.318479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.319186 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.320150 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.320840 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.321526 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.640860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.650278 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-337328ba-fdfc-4020-9b69-4193414b2d08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.459504 Oct 02 00:58:52.651560 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 205/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:52 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:52.679077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.693204 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6294241b-23c9-47d0-b648-944b46e995f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.390918 Oct 02 00:58:52.694299 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 184/389] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:52 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:52.700649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:52.701212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:52.717999 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.721536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.722124 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.723054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.723516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.723936 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.900670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.914806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.916607 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.918084 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-93109553-9838-4fae-9465-e55336548896 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.224120 Oct 02 00:58:52.920379 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 206/390] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:52 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:53.684715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:53.686418 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:53.698845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.700044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.700866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.701839 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.702528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.718376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.727366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:53.728793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:53.749254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.751987 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.754936 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.756294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.757731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.758579 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.064381 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.090894 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-33750dff-18be-4448-963a-ec4161feb7ae tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.412727 Oct 02 00:58:54.107795 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 185/391] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:53 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:54.119247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:54.119892 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:54.126881 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:54.131271 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.132085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.132761 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.134236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.134904 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.135823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.144774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.220222 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9bf45833-05cb-42b8-bf4e-99759b2223ca tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.500396 Oct 02 00:58:54.235001 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 207/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:53 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:54.557914 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.571240 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.572902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.587877 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d4d5d684-5dfa-4086-bfb5-3649b6f49fe4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1741 microversion: 2.20 time: 0.465608 Oct 02 00:58:54.592719 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 186/393] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:54 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1741 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:55.138400 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:55.139220 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:55.162363 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.163157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.163796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.164770 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.165413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.166005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.257226 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:55.258108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:55.269515 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.270374 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.270962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.271952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.272655 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.281056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.684796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:55.694882 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d2157887-1f78-4476-a5d9-1e342c46bc55 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.560985 Oct 02 00:58:55.695488 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 208/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:55 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:55.700821 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:55.713947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:55.719753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:55.731231 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-63a3951d-81cb-45be-b68d-1236a2aa608d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1513 microversion: 2.1 time: 0.478247 Oct 02 00:58:55.741783 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 187/395] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:55 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1513 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:55.757652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.758279 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.758752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.759511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.759974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.760415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.098296 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.121513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.125595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.128412 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a827829c-33de-4c0a-a248-adf237667769 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1723 microversion: 2.20 time: 0.431814 Oct 02 00:58:56.129607 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 209/396] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:55 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:56.279201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85428c9-8c3d-40b5-b776-b6d8770c19ae", "name": "network-vif-deleted", "tag": "67bdabce-23a3-48b0-885b-673d2dbea340"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:56.290920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.291782 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.292413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.305752 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] Creating event network-vif-deleted:67bdabce-23a3-48b0-885b-673d2dbea340 for instance b85428c9-8c3d-40b5-b776-b6d8770c19ae on hv-cinder-maste Oct 02 00:58:56.312402 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-7f8998f7-54db-4395-b14d-82436c4f5682 req-37004ddb-76fd-4231-9949-ba7bac6c8dce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039539 Oct 02 00:58:56.313902 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 188/397] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:56.724375 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:56.725184 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:56.732436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.733103 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.733675 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.734664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.735358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.736030 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.773793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:56.774944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:56.784289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.785168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.786066 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.786941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.787543 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.788170 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.906010 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.909868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:56.916303 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a3e0e8f8-e247-4aac-9cd4-31aeec642325 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1471 microversion: 2.1 time: 0.147649 Oct 02 00:58:56.917261 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 189/398] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:56 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:56.988952 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.995947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:57.009562 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ccc02275-9ead-4eac-a6d5-ffc06795205e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.288836 Oct 02 00:58:57.011333 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 210/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:56 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:57.160742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:57.162290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:57.170923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.171545 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.172059 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.172841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.174250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.175096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.365100 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.395913 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.400579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.406213 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-92ba7b10-e53f-4071-93c2-73ad394f1b9b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1723 microversion: 2.20 time: 0.249390 Oct 02 00:58:57.408479 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 190/400] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:57 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:57.947639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:57.948593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:57.967764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.970139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.970797 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.972144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.973057 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.973982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.040861 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:58.042180 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:58.060766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.062063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.066523 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.069618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.070664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.073497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.130544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.140222 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-505feb12-533f-4f3c-8163-0209cdf64424 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1304 microversion: 2.1 time: 0.200613 Oct 02 00:58:58.154344 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 211/401] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:57 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:58.297306 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.333979 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-47fb02ee-6f8d-4e0d-91a1-cca4488f3441 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.302197 Oct 02 00:58:58.352575 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 191/402] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:58 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:58.438685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:58.439891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:58.451037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.452102 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.452756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.454191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.454924 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.455502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.817525 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.830930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.833559 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.835185 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-71364cce-39c3-48df-bf4c-63d3d366505c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1723 microversion: 2.20 time: 0.403382 Oct 02 00:58:58.836044 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 212/403] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:58 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:58.897476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "name": "network-vif-unplugged", "status": "completed", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:58.908928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.909897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.910387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.925119 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] Creating event network-vif-unplugged:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:58:58.948068 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-b3747281-599c-47fa-a346-31f5032d7b88 req-b98b52e6-020d-4adc-bcc7-35835ba8e849 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054667 Oct 02 00:58:58.952686 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 192/404] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:59.169082 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:59.170067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:59.179803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.181005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.181667 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.182591 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.184889 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.185923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.227780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.228751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.229629 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.231014 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lazy-loading 'fault' on Instance uuid b85428c9-8c3d-40b5-b776-b6d8770c19ae {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:59.289612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:59.301211 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c87634a4-96d2-418c-9a09-8d307086a510 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1309 microversion: 2.1 time: 0.137794 Oct 02 00:58:59.302205 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 213/405] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:59 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:59.374898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:59.375614 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:59.382765 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.383530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.384157 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.385079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.385860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.386192 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.549837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:59.558508 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fdb5f144-9cd7-4562-a02e-6974efa05f20 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.189669 Oct 02 00:58:59.560036 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 193/406] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:59 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:59.867549 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:59.868386 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:59.876132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.876624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.877297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.878080 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.878489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.878930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.032093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.041334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.043821 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.046216 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6f686112-e0e1-450d-aeef-d8b10ee895fc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1666 microversion: 2.20 time: 0.183079 Oct 02 00:59:00.046978 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 214/407] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:59 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:00.071302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f15e6aec-431c-4cc6-8923-569109c93a67"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:00.073778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.081427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.081917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.082351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.083055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.083754 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.084172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.334162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:00.335077 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.345130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.345641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.346075 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.346776 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.347639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.348063 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.410019 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.410511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.416563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.417092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lazy-loading 'fault' on Instance uuid b85428c9-8c3d-40b5-b776-b6d8770c19ae {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:00.443262 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6750b98e-8501-44a1-b598-c307c327e210 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.375717 Oct 02 00:59:00.446386 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 194/408] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Oct 2 00:59:00 2022] POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:59:00.485531 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.494107 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6f7e99fd-e555-4b56-8007-175bac4ef865 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 200 len: 1309 microversion: 2.1 time: 0.167801 Oct 02 00:59:00.495318 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 215/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:00 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:00.583019 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:00.583718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.599081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.600273 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.601035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.603770 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.607412 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.609958 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.639342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:00.640982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.648841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.649760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.650443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.651530 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.653022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.653666 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.707914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120760) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 00:59:00.853880 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fe18a066-11e4-4819-bbbf-9241b6dc0df9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/action" status: 202 len: 0 microversion: 2.20 time: 0.219374 Oct 02 00:59:00.858101 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 216/410] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 2 00:59:00 2022] POST /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:59:00.874661 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:00.876175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.890523 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.892309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.893580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.896039 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.897140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.898085 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:01.193429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.204203 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bea4b233-cadd-4c46-9bef-9463a25ecc36 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.625906 Oct 02 00:59:01.219017 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 195/411] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:00 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:01.242642 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.256332 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.258240 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.259632 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-941aad02-b2e6-4019-8d0e-3b904daece16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1752 microversion: 2.20 time: 0.397152 Oct 02 00:59:01.275833 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 217/412] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:00 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1752 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:01.520222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:01.520664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: b85428c9-8c3d-40b5-b776-b6d8770c19ae] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:01.528372 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:01.529051 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:01.529532 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:01.530525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:01.531222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:01.531739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:01.547271 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] HTTP exception thrown: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Request method failure captured: Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae HTTP/1.1 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOHy5QoB8yGYUgRsJYeYY-nzximPD9j_1N1sbOe6671a4_8-U017FhOMGDbBqhChVq8Pw8dr0Zmal2EEVHbpfCXYMc-bBbwfzYu_gYY3FC6cjp0ruhfL5ftc-x3KnLQUaytDyodysZjDUwNPM2Wz5cyR8it3elp7l1rqfSz4kX1GHhE Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: c4bf24ea75824896bf7c33c3037e3654 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:59:01.549091 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: c4bf24ea75824896bf7c33c3037e3654 Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesSnapshotTestJSON-1103048048-project Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 7abd8f370307422880a120981aa4b755 Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103048048-project Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. Oct 02 00:59:01.550443 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'b85428c9-8c3d-40b5-b776-b6d8770c19ae'} Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:01.551243 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. Oct 02 00:59:01.552472 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:01.555047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Returning 404 to user: Instance b85428c9-8c3d-40b5-b776-b6d8770c19ae could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:01.556119 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a219010a-17ef-41bc-a8fc-e126a6124ab2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae" status: 404 len: 111 microversion: 2.1 time: 0.040098 Oct 02 00:59:01.557457 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 196/413] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:01 2022] GET /compute/v2.1/servers/b85428c9-8c3d-40b5-b776-b6d8770c19ae => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:02.229602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:02.232554 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:02.241594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.244489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.246795 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.249177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.251139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.253509 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.290155 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:02.290966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:02.310254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.311584 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.314459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.316862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.317568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.322037 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.666850 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:02.678497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:02.682760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:02.685705 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-23f4266f-d7f6-4be9-8d31-5d02927eaffe tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1752 microversion: 2.20 time: 0.399979 Oct 02 00:59:02.686967 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 197/414] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:02 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1752 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:02.688539 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:02.715865 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f8c495d8-a27c-4d79-92fc-12f44994a10c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.490601 Oct 02 00:59:02.723914 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 218/415] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:02 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:02.805720 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "name": "network-vif-plugged", "status": "completed", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:02.823197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.824874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.826834 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.843653 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] Creating event network-vif-plugged:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 00:59:02.853657 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-6894f97c-776f-4a77-84eb-0d81c7b1fe59 req-f26afd5c-f432-4fab-927e-f65ae4e771d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052234 Oct 02 00:59:02.857934 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 198/416] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:03.722431 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:03.723195 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:03.750563 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:03.752226 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:03.763407 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.764058 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.764564 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.765741 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:03.766378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.767323 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.767912 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:03.769047 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.771703 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:03.775500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.777814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.778900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:04.050979 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.052586 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.061540 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d1397e70-b5f2-4072-a1ab-e49c0ee014a2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1371 microversion: 2.1 time: 0.318429 Oct 02 00:59:04.062336 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 199/417] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:03 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:04.073221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.088887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.098880 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ca9872b2-4c43-4c76-9cd1-bbc04381eb69 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1754 microversion: 2.20 time: 0.377983 Oct 02 00:59:04.101206 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 219/418] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:03 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1754 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:05.087710 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.089185 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.100347 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.101722 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.106380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.107701 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.108340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.110002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.131041 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.132312 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.143177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.147552 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.148417 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.151119 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.151597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.152129 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.572131 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.599267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.623713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.638725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.644877 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b0acf839-5fec-4c30-8057-c68be12f8e92 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.518551 Oct 02 00:59:05.646847 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 220/419] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:05.664605 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9e53f38d-0109-40ed-8608-23b198f45c37 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1564 microversion: 2.1 time: 0.574655 Oct 02 00:59:05.666106 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 200/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1564 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:05.698101 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.698601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.710905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.715250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.717721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.718491 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.720362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.722815 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.843098 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-275780217", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "networks": [{"uuid": "c05c623a-66ff-43b1-8713-87216e762a99"}]}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:05.881190 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-edc0d559-6185-4b6c-a696-119887a0c730 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189424 Oct 02 00:59:05.882419 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 221/421] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:05.985161 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] validate_networks() for [('c05c623a-66ff-43b1-8713-87216e762a99', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:59:06.676313 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:06.677505 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:06.692270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.693234 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.695418 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.697481 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.698405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.699722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:07.175305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:07.197752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:07.199421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:07.200927 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-189ad27a-eb76-44d2-a81f-813b7f58e379 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.529293 Oct 02 00:59:07.204379 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 222/422] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:06 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:07.209571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-712955448", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:07.514576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:59:07.516110 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:59:07.516865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:59:07.518386 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:59:07.518979 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:59:07.532323 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:07.533056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:07.534126 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:07.535623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:07.537047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:07.538041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:07.567825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Getting quotas for project c4bf24ea75824896bf7c33c3037e3654. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:59:07.573430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Getting quotas for user 7abd8f370307422880a120981aa4b755 and project c4bf24ea75824896bf7c33c3037e3654. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:59:07.588486 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:59:07.592114 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:59:07.693134 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8bd8aee7-a92a-4377-9e43-d04cd52aa4ce tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854335 Oct 02 00:59:07.698143 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 201/423] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:59:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:59:07.728580 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-12caec26-dac4-40e7-a9ca-3f9533b02e19 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:07.732443 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-12caec26-dac4-40e7-a9ca-3f9533b02e19 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:07.850581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-12caec26-dac4-40e7-a9ca-3f9533b02e19 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:07.867743 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-12caec26-dac4-40e7-a9ca-3f9533b02e19 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1218 microversion: 2.1 time: 0.157775 Oct 02 00:59:07.868668 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 202/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:07 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:08.239627 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:08.240184 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:08.260043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.262759 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.265154 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.267815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.268512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.273295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.687487 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:08.704537 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:08.717246 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:08.722210 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bf54a151-26ef-4a76-a5d2-0f3fb527e131 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.496827 Oct 02 00:59:08.728142 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 203/425] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:08 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:08.790931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:08.801470 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.801962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.802400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.814988 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] Creating event network-changed:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 00:59:08.820702 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-602c2640-cf1d-46b9-9033-d6081c95b3e8 req-27b24373-ef46-4976-aefe-80074555c6a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034038 Oct 02 00:59:08.821545 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 204/426] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:08.928802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:08.931711 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:08.941452 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.942411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.943047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.944065 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.944728 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.946040 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:09.065434 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:09.096135 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-086b538c-8cfb-4c95-8522-994b2a9cb339 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1222 microversion: 2.1 time: 0.186500 Oct 02 00:59:09.098845 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 205/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:08 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:09.759216 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:09.759919 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:09.778235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:09.778972 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:09.779440 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:09.780197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:09.780924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:09.786183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:10.073213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:10.091546 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:10.104307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:10.106116 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-720855bb-9a78-4933-b039-b447d434f090 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.350824 Oct 02 00:59:10.106918 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 206/428] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:09 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:10.123438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:10.124339 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:10.135828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:10.137398 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:10.142447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:10.143575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:10.144201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:10.144802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:10.258043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:10.271081 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1140f323-fca3-4741-bbd3-adcda8dbc963 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1214 microversion: 2.1 time: 0.152655 Oct 02 00:59:10.273951 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 207/429] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:10 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:11.138297 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:11.139790 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:11.156745 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.157650 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.158336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.159314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.159935 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.160525 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.165290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:11.522227 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:11.545312 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:11.548831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:11.550097 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-01774a62-6d86-4af6-87db-8b13a0411eae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.416952 Oct 02 00:59:11.551234 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 208/430] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:11 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:11.560979 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:11.561610 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:11.579313 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.580018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.580471 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.583213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.583213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.583213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.722681 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:11.742589 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4e7fbbd5-3fdd-439d-a4cd-f06829749280 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1270 microversion: 2.1 time: 0.190225 Oct 02 00:59:11.743182 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 209/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:11 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:12.589200 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:12.590106 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:12.617259 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:12.618134 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:12.619694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:12.621920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:12.623944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:12.624762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:12.947013 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:12.975324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:12.979357 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:12.981036 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-45661bb2-2849-4741-b498-149c3e2811b1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.397290 Oct 02 00:59:12.982660 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 210/432] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:12 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:12.988910 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:12.989825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:13.013996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:13.015349 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:13.017531 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:13.020314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:13.021022 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:13.021709 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:13.274255 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:13.318157 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-58cf4a46-b4a5-49b5-8f06-6e79d6971216 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1278 microversion: 2.1 time: 0.334206 Oct 02 00:59:13.333194 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 211/433] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:12 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1278 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:14.019950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:14.022615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:14.034781 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:14.036364 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:14.037068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:14.038930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:14.039567 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:14.040159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:14.246537 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:14.263081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:14.267714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:14.271209 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-17b42313-e237-4eb0-98d7-7940b8e759e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.256179 Oct 02 00:59:14.273643 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 212/434] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:14 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:14.350193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:14.351237 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:14.362221 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:14.363636 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:14.364409 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:14.365501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:14.366309 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:14.367102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:14.552909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:14.568631 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b96c5a19-24d1-4c65-aac6-9e9db221bf2b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1276 microversion: 2.1 time: 0.221954 Oct 02 00:59:14.568631 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 213/435] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:14 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:15.303738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:15.304548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:15.323153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:15.325779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:15.326322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:15.327147 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:15.330734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:15.331282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:15.517376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:15.528273 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:15.530444 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:15.532148 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9fbe6720-be81-4b87-923c-b7bcba3c2749 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.233358 Oct 02 00:59:15.548965 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 214/436] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:15 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:15.593692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:15.595678 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:15.614805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:15.617158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:15.618058 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:15.622132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:15.622870 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:15.624860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:15.927123 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] validate_networks() for None {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:59:15.983764 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:15.991724 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-43347259-ea96-4647-be2a-57080b4850f1 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.404400 Oct 02 00:59:15.992301 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 215/437] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:15 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:16.331795 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:59:16.332435 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:59:16.333190 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:59:16.333730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:59:16.334523 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:59:16.346497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.347554 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.348384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.349406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.350132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.350652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.371552 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Getting quotas for project dbf4aeeacf5d4401884d7bc03bfd8504. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:59:16.376220 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Getting quotas for user 8b62ce29aeca49bf96d2ca5767e5d15a and project dbf4aeeacf5d4401884d7bc03bfd8504. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:59:16.389206 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:59:16.391654 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:59:16.445346 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-64b7fde3-a302-49cd-8149-83bcce5bef5a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.239538 Oct 02 00:59:16.446293 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 223/438] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 00:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 9241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:59:16.467767 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5aa047d1-1043-4b98-8dcd-e0ab8b591f37 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:16.475955 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5aa047d1-1043-4b98-8dcd-e0ab8b591f37 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:16.568808 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:16.569737 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:16.571846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:16.587759 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5aa047d1-1043-4b98-8dcd-e0ab8b591f37 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:16.589917 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.590468 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.591297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.592207 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.593043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.593633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.598386 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5aa047d1-1043-4b98-8dcd-e0ab8b591f37 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1214 microversion: 2.1 time: 0.139282 Oct 02 00:59:16.599694 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 216/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:16 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:16.779658 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:16.792135 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:16.795806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:16.797603 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-692b6d36-b9b0-418c-8c38-f8926d83204a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.241740 Oct 02 00:59:16.798688 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 224/440] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:16 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:17.023835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:17.024807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:17.044919 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.045568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.046078 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.046952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.048404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.048802 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.298818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:17.308888 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-05948f5a-0b82-41de-a155-53a9a88ddbc5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.289399 Oct 02 00:59:17.317152 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 217/441] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:17 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:17.626131 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:17.626974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:17.633066 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.633821 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.634406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.635278 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.640049 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.640897 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.726496 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:17.735395 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3f73ae6b-910c-4f3b-8ee3-69e8955ec5c0 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1218 microversion: 2.1 time: 0.113295 Oct 02 00:59:17.736086 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 225/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:17 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:17.824167 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:17.825084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:17.827653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:17.846775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.847421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.848820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.849733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.851553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.853148 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.116127 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.131061 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.136307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.138728 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1c5a5a95-ac96-414c-8d19-d63ce9975578 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.318463 Oct 02 00:59:18.139585 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 218/443] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:17 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:18.341870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:18.342914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:18.353492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:18.354766 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:18.355671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.356608 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:18.357387 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:18.358042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.577090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.580197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:18.594871 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ab8eeba7-1363-4088-a46e-33da4711c888 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.263203 Oct 02 00:59:18.611743 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 226/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:18 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:18.760095 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:18.760769 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:18.767961 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:18.768751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:18.769749 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.771583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:18.772486 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:18.773121 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.853808 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.873175 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7108c8c4-8a51-4902-bf41-405614f08a2b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1218 microversion: 2.1 time: 0.116948 Oct 02 00:59:18.874095 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 219/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:18 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:19.171864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:19.172504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:19.181477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.181987 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.183142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.183919 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.184724 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.185577 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.362002 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:19.379500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:19.381392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:19.382780 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4ab58c59-d511-48d2-bcf7-bac025aafe7d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.214869 Oct 02 00:59:19.383497 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 227/446] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:19 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:19.636183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:19.636799 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:19.644901 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.645879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.646666 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.647998 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.648931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.650009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.805286 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:19.814693 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e9fd0d3a-1e5a-4557-8817-dff539a9734c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.182386 Oct 02 00:59:19.815134 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 220/447] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:19 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:19.903426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:19.905077 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:19.916629 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.917610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.918235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.919193 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.919806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.920390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.002290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:20.012102 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9e4bb078-cfe6-456a-afcd-d70733e71aae tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1218 microversion: 2.1 time: 0.113927 Oct 02 00:59:20.012704 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 228/448] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:19 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:20.411199 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:20.412397 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:20.422179 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.422724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.423344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.424101 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.424739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.425384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.580037 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:20.590900 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:20.593380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:20.594733 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5ebecf95-eda2-481d-80e9-0f4fdb274c35 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.188439 Oct 02 00:59:20.595384 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 221/449] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:20 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:20.819589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da1ad91-e1f0-434d-9ff8-d6f59224f885", "tag": "252b634c-bbf0-451d-a002-2cc6b8365da3"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:20.833561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.834044 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.834474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.852272 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] Creating event network-changed:252b634c-bbf0-451d-a002-2cc6b8365da3 for instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 on hv-cinder-maste Oct 02 00:59:20.856748 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:20.857471 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:20.858542 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-458f14a2-e45f-4799-af35-d8052e40f2dd req-7ddeb5f4-fd9e-448c-83f8-d7aa5367da62 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043812 Oct 02 00:59:20.859300 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 229/450] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:20.866863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.867674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.868098 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.868818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.869293 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.870427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.033490 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.041130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:21.043289 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:21.044107 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ce1c1c1c-3e35-4f97-8aa3-c2bcd0f9a677 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.191856 Oct 02 00:59:21.045257 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 222/451] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:20 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:21.051029 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.051681 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.052421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.054111 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.054722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.055262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.136520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.145346 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9ad62609-a6c9-45cd-ac13-980eeebb5f3c tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1210 microversion: 2.1 time: 0.111432 Oct 02 00:59:21.146212 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 230/452] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:21 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:21.648327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:21.649631 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:21.673344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.673837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.674277 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.674992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.675476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.675920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.957625 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.971689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.973604 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.975381 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9495aa6f-e311-4311-87e8-cd1e9fe49a85 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.334336 Oct 02 00:59:21.976466 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 223/453] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:21 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:22.069348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:22.070078 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:22.078858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.079635 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.080287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.081274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.081947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.082573 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.170472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:22.171108 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:22.183666 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.184379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.184879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.185732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.186277 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.186671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.288875 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:22.291805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:22.299040 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-de210217-4072-4e9e-9e60-1233c85ac98e tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.233433 Oct 02 00:59:22.299632 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 231/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:22 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:22.300558 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d8da5b8c-213e-4289-a753-173e196db2ab tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1266 microversion: 2.1 time: 0.134633 Oct 02 00:59:22.301350 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 224/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:22 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:23.004097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:23.005306 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:23.016927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.017759 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.018542 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.019397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.020100 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.020694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.173781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:23.183269 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:23.184923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:23.186149 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-752d214c-04d3-492c-be12-f8f2ad12ef71 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.187821 Oct 02 00:59:23.186717 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 232/456] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:22 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:23.325973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:23.327319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:23.327446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:23.328052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:23.334271 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.334480 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.334985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.335430 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.335677 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.336136 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.336562 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.336682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.337341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.337931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.339291 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.340335 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.440534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:23.449432 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c4b65b19-6b07-4f0e-9238-74d0c215ef7a tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1272 microversion: 2.1 time: 0.127637 Oct 02 00:59:23.450329 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:23 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:23.511340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:23.515320 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:23.520504 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3eeef1bc-080d-496d-ab18-e762c85770b5 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.199382 Oct 02 00:59:23.521239 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 225/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:23 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:24.212780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:24.214303 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:24.220524 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.221059 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.221503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.222218 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.222679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.223122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.372602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.381818 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.383290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.384465 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c72298fc-1b71-4226-874b-3b677bd2f86f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.175833 Oct 02 00:59:24.385282 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 234/459] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:24 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:24.474710 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:24.475275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:24.478042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:24.484752 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.485282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.485937 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.486665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.487175 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.487568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.544988 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:24.545609 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:24.552031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.552525 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.552997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.553912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.554175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.554609 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.738497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.748169 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f52a07f7-0a26-416d-a850-12462c48eaf3 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.277656 Oct 02 00:59:24.749129 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 226/460] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:24 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:24.755102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206477dc-6f70-447a-b1c8-2533c6b3ca17", "tag": "1c2916ed-0479-4984-94cc-c690ad75b19c"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:24.768447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:24.769359 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:24.770038 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:24.790138 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] Creating event network-changed:1c2916ed-0479-4984-94cc-c690ad75b19c for instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 on hv-cinder-maste Oct 02 00:59:24.796843 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-1a3524e2-2dcf-47b8-8187-594c8467e37e req-dc88073e-fa41-4f3c-a743-c11e0365823c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046237 Oct 02 00:59:24.797852 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 227/461] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:24.799774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.808133 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4e6c11f4-3df8-4209-858e-0ecfcddf255c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.268169 Oct 02 00:59:24.809620 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 235/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:24 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:25.065253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "name": "network-vif-plugged", "status": "completed", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:25.078208 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.078884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.079437 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.097035 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] Creating event network-vif-plugged:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 00:59:25.107092 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-03074754-fd1d-48da-b8a8-9d554829b91c req-3d110f6a-b108-4844-8644-386d902f5631 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045870 Oct 02 00:59:25.107698 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 228/463] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:25.411540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:25.412578 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:25.420388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.420388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.420704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.422286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.422286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.422286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.577177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:25.586513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:25.587969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:25.589744 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ae7c5ae2-2567-465e-a72e-06dd0defe71b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.182109 Oct 02 00:59:25.590231 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 236/464] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:25 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:25.778938 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:25.779559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:25.786261 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.786755 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.787197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.787894 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.788358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.788790 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.832902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:25.833553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:25.840262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.840748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.841211 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.841911 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.842361 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.842781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.965106 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:25.972874 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e82c980b-4cdc-4ca3-9175-8df82d3c6881 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.199328 Oct 02 00:59:25.973478 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 229/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:25 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:26.010104 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:26.017971 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b457a61d-51c3-4842-8348-2f7982f07103 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.189012 Oct 02 00:59:26.018536 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 237/466] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:25 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:26.617242 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:26.617912 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:26.621995 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=10 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:26.626162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:26.626662 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:26.627110 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:26.627821 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:26.628279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:26.628711 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:26.775508 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:26.785424 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:26.786900 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:26.788081 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3b031f1d-9176-4d95-b37f-5846aabfa78e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.175926 Oct 02 00:59:26.796222 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 230/467] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:26 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:26.996406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:26.997056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:26.999004 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:26.999672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:27.005335 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.005831 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.006278 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.006986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.007446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.007874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.041233 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:27.042971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:27.049253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.049751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.050194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.050907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.051368 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.051799 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.191932 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:27.201696 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-74062073-3c66-4f1d-8e48-d33031de808d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.209797 Oct 02 00:59:27.202834 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 238/468] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:26 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:27.207337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da1ad91-e1f0-434d-9ff8-d6f59224f885", "name": "network-vif-plugged", "status": "completed", "tag": "252b634c-bbf0-451d-a002-2cc6b8365da3"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:27.219329 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.219815 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.220376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.223478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:27.232073 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2b570d04-41cd-4bc0-ae4e-3b8b0ecb6b01 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.194632 Oct 02 00:59:27.232650 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 231/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:27 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:27.238222 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] Creating event network-vif-plugged:252b634c-bbf0-451d-a002-2cc6b8365da3 for instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 on hv-cinder-maste Oct 02 00:59:27.242941 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-6359fb12-cb8b-4f47-9ddc-cf21c914588f req-69d64d02-8a9a-42a2-a52a-df781b92c4c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039002 Oct 02 00:59:27.243512 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 239/470] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:27.815517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:27.816070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:27.822626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.823722 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.824169 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.824887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.825382 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.825816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.963157 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:27.972847 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:27.974340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:27.975504 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c5fa8111-f831-4590-a104-1ffc4822a2c1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.164811 Oct 02 00:59:27.976053 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 232/471] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:27 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:28.226226 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:28.227070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:28.233725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.234221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.234663 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.235393 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.235857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.236287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.254504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:28.255116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:28.261775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.262332 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.262713 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.263415 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.263876 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.264314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.451008 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:28.454342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:28.459595 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e8293466-3cb8-4fcf-8192-0b97c5eac8c7 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.208913 Oct 02 00:59:28.460985 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 233/472] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:28 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:28.462164 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1ef0103f-7b3d-4ff4-b7d3-23085dfae497 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.240535 Oct 02 00:59:28.462900 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 240/473] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:28 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:29.001437 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:29.002179 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:29.010292 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.010885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.011477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.012258 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.012791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.013309 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.151899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.160566 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.162063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.163225 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ed690f0a-5cb6-400d-9159-b272b9977076 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1810 microversion: 2.20 time: 0.166038 Oct 02 00:59:29.163787 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 234/474] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:28 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:29.483473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:29.484268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:29.484733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:29.485368 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:29.492834 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.493702 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.494365 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.496887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.497617 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.497744 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.498132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.498257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.498934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.499151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.499406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.499839 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.702774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.706236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.711082 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d322228c-d803-4fce-8d58-75abdf966f9a tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1318 microversion: 2.1 time: 0.232408 Oct 02 00:59:29.711651 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 241/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:29 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:29.716142 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9f50ab3b-e076-4f06-b237-f6e50fdb2e53 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.235353 Oct 02 00:59:29.716796 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 235/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:29 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:30.188906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:30.189516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:30.195627 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.196113 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.196548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.197271 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.198244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.198672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.331713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.340473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.341949 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.343112 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-432961f7-2a5b-4937-9c61-960b41712038 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1797 microversion: 2.20 time: 0.158257 Oct 02 00:59:30.343670 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 242/477] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:30 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1797 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:30.734966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:30.735572 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:30.739946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:30.742669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:30.742845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.743236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.743673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.744778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.745907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.746337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.754264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.755397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.756494 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.758073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.759160 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.760744 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.957035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.961071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.970707 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4d3f19b0-7f4e-4228-82a1-abf4b4256e50 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.234600 Oct 02 00:59:30.973377 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-52a7f85d-9dfd-480a-85a0-8fd214691a1b tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1507 microversion: 2.1 time: 0.242227 Oct 02 00:59:30.985207 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 243/478] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:30 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:30.985506 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 236/479] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:30 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:30.992148 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206477dc-6f70-447a-b1c8-2533c6b3ca17", "name": "network-vif-plugged", "status": "completed", "tag": "1c2916ed-0479-4984-94cc-c690ad75b19c"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:30.997576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac60b170-47b9-4c10-a3e8-c57ffb70761e", "device": "/dev/sdb"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:31.000118 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:31.001987 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:31.002473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:31.002919 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:31.005933 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:31.006428 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:31.006869 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:31.007573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:31.008036 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:31.008473 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:31.013986 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] Creating event network-vif-plugged:1c2916ed-0479-4984-94cc-c690ad75b19c for instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 on hv-cinder-maste Oct 02 00:59:31.018849 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-a631e8f9-fd84-4660-8db0-631c5c3ebcdb req-18d9a4b0-7511-4def-bae1-bb43d606244c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Oct 02 00:59:31.019443 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 244/480] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:31.311841 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-dde529d8-ce80-436f-a753-5cf293b1f859 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "POST /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318362 Oct 02 00:59:31.312485 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 237/481] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:59:30 2022] POST /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:32.000221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.001793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:32.008239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.008734 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.009239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.010211 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.010504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.010854 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.028995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:32.159632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:32.167452 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-edd94481-b068-496b-a051-e3eae1def222 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.172089 Oct 02 00:59:32.168026 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 245/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:31 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:32.450217 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.450864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:32.457051 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.457536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.457964 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.458656 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.459106 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.459519 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.598044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'services' on Instance uuid b015e40c-98d7-4fec-98e1-ad84b496767b {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:32.712544 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-da225d0e-05c4-4a93-b7e9-ac8e07fc340b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments/722b2a9d-6d7a-4ff1-b0ed-c2ae1983ab46" status: 202 len: 0 microversion: 2.1 time: 0.268595 Oct 02 00:59:32.713241 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 238/483] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 00:59:32 2022] DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments/722b2a9d-6d7a-4ff1-b0ed-c2ae1983ab46 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:33.189937 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:33.190567 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:33.196611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.197144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.197902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:33.198682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.199146 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.199575 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:33.332421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:33.340229 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4b9e58c4-dfc1-44d5-8270-c1fdc43a10d7 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1314 microversion: 2.1 time: 0.154181 Oct 02 00:59:33.340787 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 246/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:33 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:34.364130 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:34.364823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:34.371540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.372028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.372466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.373201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.373659 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.374120 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.513604 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:34.521579 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4f6f4bea-5fa7-41f9-ba8a-5eb423433e1b tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1464 microversion: 2.1 time: 0.162205 Oct 02 00:59:34.522153 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 239/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:34 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:34.583614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:34.584850 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:34.591758 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.592367 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.592803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.593530 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.593986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.594414 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.620200 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:34.708056 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b806c803-6ffe-4ea9-8252-41623b0cc840 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "DELETE /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 204 len: 0 microversion: 2.1 time: 0.128932 Oct 02 00:59:34.714114 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 247/486] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:34 2022] DELETE /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:34.720932 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:34.722153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:34.731030 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.732093 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.732738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.733885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.734329 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.734804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.906857 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:34.914839 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7dcb36be-bfc9-4e54-b6b1-b139cbf4fb9d tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1470 microversion: 2.1 time: 0.199229 Oct 02 00:59:34.915630 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 240/487] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:34 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:35.201478 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "ac60b170-47b9-4c10-a3e8-c57ffb70761e", "create_info": {"type": "qcow2", "new_file": "volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.48ab452a-3e02-4867-b86c-a8a8947f8ff1.vhdx", "snapshot_id": "48ab452a-3e02-4867-b86c-a8a8947f8ff1"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:35.204743 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.205259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.205698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.214199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.214579 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.215006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.229642 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-c6ad2a76-31e0-4d7e-b342-1c74469abdae req-1ae6e2d9-0541-425c-90b3-853283408f5d admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.150507 Oct 02 00:59:35.230397 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 248/488] 10.222.0.36 () {64 vars in 1326 bytes} [Sun Oct 2 00:59:35 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:59:35.939315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:35.939992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:35.946816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.948005 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.948663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.949497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.949969 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.950402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.969242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:35.976215 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.976706 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.977182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.002228 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Going to try to stop instance {{(pid=120760) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 00:59:36.057413 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5d6d7a53-3428-405d-90f4-1af8361d3eae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action" status: 202 len: 0 microversion: 2.1 time: 0.092158 Oct 02 00:59:36.058523 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 249/489] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:59:35 2022] POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 00:59:36.067056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.068080 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:36.075745 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.076242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.076687 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.077446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.078087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.078683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.117923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:36.122326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:36.127661 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-86898c17-f0b6-4a4f-8dc4-466256ac3474 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1470 microversion: 2.1 time: 0.192217 Oct 02 00:59:36.128241 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 241/490] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:36.218064 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:36.225868 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5a9ab7e5-09ba-4541-b8ff-7fca7d0de344 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.163097 Oct 02 00:59:36.226433 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 250/491] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:37.152318 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:37.152957 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:37.161028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.161605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.162051 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.162766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.163235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.163665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.252204 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:37.253102 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:37.260481 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.260998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.261465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.262203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.262655 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.263081 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.329340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:37.338139 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e1f32522-2a05-4403-b68b-8f06bc95d471 tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1470 microversion: 2.1 time: 0.189518 Oct 02 00:59:37.338869 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 242/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:37 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:37.431224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:37.446949 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4044535c-4175-485a-9ae3-5261f9645c5b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.199846 Oct 02 00:59:37.447955 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 251/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:37 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:38.362420 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:38.363275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:38.370355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:38.370850 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:38.371377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.372114 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:38.372837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:38.373620 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.487746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:38.489445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:38.496860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:38.497612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:38.498125 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.498903 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:38.499595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:38.500037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.522265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b62ce29aeca49bf96d2ca5767e5d15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:38.555561 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aa6c6a63-85ae-4469-9a2f-1ca3ba21360f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 200 len: 1470 microversion: 2.1 time: 0.197345 Oct 02 00:59:38.556144 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 243/494] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:38 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:38.633700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206477dc-6f70-447a-b1c8-2533c6b3ca17", "name": "network-vif-deleted", "tag": "1c2916ed-0479-4984-94cc-c690ad75b19c"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:38.647731 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:38.648329 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:38.649810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.652916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:38.662008 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-078f761a-ffaa-401a-a8f0-5fa9e701c929 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.177896 Oct 02 00:59:38.663058 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 252/495] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:38 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:38.664812 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] Creating event network-vif-deleted:1c2916ed-0479-4984-94cc-c690ad75b19c for instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 on hv-cinder-maste Oct 02 00:59:38.674858 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-2ebdd2bc-ecc5-4949-b7ee-4dff2a0213e1 req-091917ef-771b-497a-b688-e8feb6f2b244 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048099 Oct 02 00:59:38.677200 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 244/496] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:39.321179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "ac60b170-47b9-4c10-a3e8-c57ffb70761e", "create_info": {"type": "qcow2", "new_file": "volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.a861daad-7cc4-4b42-b791-a3ab78d9c0cd.vhdx", "snapshot_id": "a861daad-7cc4-4b42-b791-a3ab78d9c0cd"}}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:39.325199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.325683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.326111 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.334291 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.334760 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.335187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.348391 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-2675f52e-c874-4a62-abc0-d67fda3998cf req-371e8653-a9fd-4d7a-9486-af2caf848da2 admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.078020 Oct 02 00:59:39.348997 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 253/497] 10.222.0.36 () {64 vars in 1326 bytes} [Sun Oct 2 00:59:39 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 00:59:39.582083 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:39.582785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] [instance: 206477dc-6f70-447a-b1c8-2533c6b3ca17] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:39.589345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.589837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.590267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.590959 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.591412 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.591835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.605677 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] HTTP exception thrown: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Request method failure captured: Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 HTTP/1.1 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOJYuv0i-Knsrr5JUTSgj2uYjDKFDxy-PjCcJbIK7FRWpMYSTyL-5qiJCY6w4gtRkvrVjo9lRxOc6Ff-51hhTOWeOvXq5isMM08X1aOflE9pkq8ttSL0o171OTS1GjsWtQJeWcwKiR5pVrCaTSda4RXz_OzffkxrY9sK19z7dObfYlY Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: dbf4aeeacf5d4401884d7bc03bfd8504 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesNegativeTest-1706219717 Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 00:59:39.607279 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbf4aeeacf5d4401884d7bc03bfd8504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbf4aeeacf5d4401884d7bc03bfd8504"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbf4aeeacf5d4401884d7bc03bfd8504"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbf4aeeacf5d4401884d7bc03bfd8504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesNegativeTest-1706219717 Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: dbf4aeeacf5d4401884d7bc03bfd8504 Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesNegativeTest-1706219717 Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesNegativeTest-1706219717-project Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 8b62ce29aeca49bf96d2ca5767e5d15a Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesNegativeTest-1706219717-project Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. Oct 02 00:59:39.608652 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '206477dc-6f70-447a-b1c8-2533c6b3ca17'} Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:39.609468 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. Oct 02 00:59:39.610800 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 00:59:39.612203 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] Returning 404 to user: Instance 206477dc-6f70-447a-b1c8-2533c6b3ca17 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:39.612203 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ad6a6882-81a1-4bbd-b0c1-f74c0bd1c53f tempest-VolumesNegativeTest-1706219717 tempest-VolumesNegativeTest-1706219717-project] 10.222.0.26 "GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17" status: 404 len: 111 microversion: 2.1 time: 0.031372 Oct 02 00:59:39.612203 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 245/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:39 2022] GET /compute/v2.1/servers/206477dc-6f70-447a-b1c8-2533c6b3ca17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 00:59:39.689394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:39.690814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:39.700051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.700557 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.701033 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.702488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.702965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.703403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.849252 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:39.858290 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ef79aea9-7601-4b35-ab4a-7fd4ca8414b0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.173770 Oct 02 00:59:39.858901 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 254/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:39 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:40.881830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:40.882435 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:40.890184 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.890678 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.891116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:40.891809 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.892267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.892694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:41.031674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:41.040011 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-690ce542-29e4-4929-957d-56918c25ed5d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.161974 Oct 02 00:59:41.040561 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 246/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:40 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:42.063730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:42.064398 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:42.070857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.071426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.072962 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.073754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.074295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.074797 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.224408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:42.234273 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ff16a1b5-6355-44da-8877-0b62c8279a62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.174452 Oct 02 00:59:42.235405 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 255/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:42 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:42.587820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:42.591361 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.591873 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.592340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.600653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.601166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.601734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.616278 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-27126170-79c5-4dd5-90a6-2557ed6e53ef req-d1cfc3d1-c143-4a63-a906-19cab79b9098 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a861daad-7cc4-4b42-b791-a3ab78d9c0cd?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.a861daad-7cc4-4b42-b791-a3ab78d9c0cd.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087946 Oct 02 00:59:42.616812 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 247/502] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:59:42 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a861daad-7cc4-4b42-b791-a3ab78d9c0cd?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.a861daad-7cc4-4b42-b791-a3ab78d9c0cd.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:43.260961 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:43.261587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:43.267593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.268084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.268522 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.269240 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.269703 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.270130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.415898 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:43.421337 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1f306c85-99d5-4c35-9588-036936202e85 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.164430 Oct 02 00:59:43.421913 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 256/503] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:43 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:44.447380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:44.448116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:44.454623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:44.455116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:44.455560 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:44.456258 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:44.456719 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:44.457175 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:44.592206 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:44.599899 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-26cc8c43-1695-4da9-b79c-bf8199365f1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.157860 Oct 02 00:59:44.600455 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 248/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:44 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:45.623992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:45.624607 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:45.630783 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.631273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.631712 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.632408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.632866 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.633324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.771919 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:45.780429 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a86fcacb-87b9-4938-a4f5-e830164d2e62 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.161207 Oct 02 00:59:45.781300 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 257/505] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:45 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:45.886081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:45.889409 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.889896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.890332 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.898608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.899085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.899519 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.914136 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-ee1ba300-7862-451b-90b4-e02574a63f24 req-5ccd5569-9d80-4128-8991-c816a696603b admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/1cbdb2c1-9d30-421c-9315-3e4d39b241e7?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.1cbdb2c1-9d30-421c-9315-3e4d39b241e7.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.144330 Oct 02 00:59:45.914622 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 249/506] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:59:45 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/1cbdb2c1-9d30-421c-9315-3e4d39b241e7?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.1cbdb2c1-9d30-421c-9315-3e4d39b241e7.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:59:46.803877 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:46.804393 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:46.806496 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:46.812586 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:46.813118 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:46.813561 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:46.814264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:46.814727 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:46.815186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:46.946505 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:46.954323 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f4d36616-84be-49a1-87cf-4518e22c20e5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1679 microversion: 2.1 time: 0.154417 Oct 02 00:59:46.954887 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 258/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:46 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:47.977932 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 00:59:47.978450 dv-cinder-master-3-smb devstack@n-api.service[120759]: Sun Oct 2 00:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b (ip 10.222.0.26) !!! Oct 02 00:59:47.982886 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:47.983580 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:47.990810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.991291 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.991719 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:47.992404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.992854 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.993371 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.130615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:48.138382 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d4d6ebfa-2d70-4cc7-97e5-f840c6f16b96 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1656 microversion: 2.1 time: 0.162430 Oct 02 00:59:48.138955 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 250/508] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:47 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:48.160812 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:48.167346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.167830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.168257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.191032 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Going to try to start instance {{(pid=120760) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 00:59:48.224273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:48.234675 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ada18f28-d660-429f-b2f0-47c1946794b1 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action" status: 202 len: 0 microversion: 2.1 time: 0.077487 Oct 02 00:59:48.235217 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 259/509] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:59:48 2022] POST /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:48.243293 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:48.243902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:48.250684 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.251266 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.251602 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.252304 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.252831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.253321 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.393050 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:48.401041 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-84f97cdd-5a03-4f02-abc7-f6edc7f900bf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1665 microversion: 2.1 time: 0.161466 Oct 02 00:59:48.401822 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 251/510] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:48 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:48.935396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:48.938671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.939152 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.939576 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.947798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.948314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.948737 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.961824 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-ea5f0f1d-c4f3-4022-be66-80eb0579c29f req-4c033b6d-164a-40e8-b359-e780b7cf42bd admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/48ab452a-3e02-4867-b86c-a8a8947f8ff1?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.48ab452a-3e02-4867-b86c-a8a8947f8ff1.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.086296 Oct 02 00:59:48.962409 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 260/511] 10.222.0.36 () {62 vars in 1800 bytes} [Sun Oct 2 00:59:48 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/48ab452a-3e02-4867-b86c-a8a8947f8ff1?delete_info=%7B%22file_to_merge%22:%20%22volume-ac60b170-47b9-4c10-a3e8-c57ffb70761e.48ab452a-3e02-4867-b86c-a8a8947f8ff1.vhdx%22,%20%22volume_id%22:%20%22ac60b170-47b9-4c10-a3e8-c57ffb70761e%22%7D => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:49.424590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:49.425238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:49.431562 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.432093 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.432530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:49.433252 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.433706 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.434127 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:49.567896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:49.576308 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-59fde738-a101-4b5e-ae31-2df987eaa03e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1665 microversion: 2.1 time: 0.155505 Oct 02 00:59:49.576872 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 252/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:49 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:50.603125 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:50.603858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:50.611292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.611781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.612219 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.612920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.613401 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.613830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.755529 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:50.763554 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5c8ee2d8-7a3e-42b8-90f8-549a58e14f13 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1669 microversion: 2.1 time: 0.164938 Oct 02 00:59:50.764129 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 261/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:50 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:52.160163 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2deab6f-8a16-4b15-8f7e-b8c447e6ad66"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:52.162621 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:52.169360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.169888 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.170436 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.171327 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.171750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.172172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.482473 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2ed2120b-949d-4860-8a9d-c5fbf8e5c6bd tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326092 Oct 02 00:59:52.483086 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 253/514] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 00:59:52 2022] POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:52.894033 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:52.894559 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:52.900491 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.901119 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.901725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.902434 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.902896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.903327 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.984525 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lazy-loading 'services' on Instance uuid 4da1ad91-e1f0-434d-9ff8-d6f59224f885 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:53.056773 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-569ed510-9b76-42b1-974f-1a8a6f3e4f74 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885/os-volume_attachments/ac60b170-47b9-4c10-a3e8-c57ffb70761e" status: 202 len: 0 microversion: 2.1 time: 0.166571 Oct 02 00:59:53.057370 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 262/515] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 00:59:52 2022] DELETE /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885/os-volume_attachments/ac60b170-47b9-4c10-a3e8-c57ffb70761e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:54.739751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:54.742177 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:54.744519 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=52 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:54.751055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.751559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.752003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.752714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.753202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.753635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.781459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'flavor' on Instance uuid 3813c50b-bd9b-4b44-a5f8-42da991274c6 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:54.909340 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-83afffaa-9670-4158-8cf0-84b316953e93 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/action" status: 200 len: 32 microversion: 2.1 time: 0.174180 Oct 02 00:59:54.911000 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 254/516] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 00:59:54 2022] POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:59:54.921295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:54.921974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:54.928772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.929845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.930290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.931165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.931618 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.932054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.073647 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.081890 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-30653076-af8a-4891-a57a-aa6c69461174 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.165577 Oct 02 00:59:55.082457 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 263/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:54 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:55.241898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:55.242152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:55.249174 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.249761 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.250300 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.251079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.251667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.252116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.280501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:55.364061 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f12ebce5-23b0-44cf-89bb-a9d331bc014c tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 204 len: 0 microversion: 2.1 time: 0.127110 Oct 02 00:59:55.364745 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 255/518] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:55 2022] DELETE /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:55.374459 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:55.375065 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:55.381117 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.381603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.382067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.382721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.383167 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.383582 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.518088 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.525750 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c71cbb5b-6438-4246-a98b-e262fe2fd8c2 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1513 microversion: 2.1 time: 0.155758 Oct 02 00:59:55.526713 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 264/519] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:55 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:56.106878 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:56.107581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:56.110040 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=4 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:56.115719 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.116205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.116638 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.117362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.117813 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.118235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.122667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:56.253829 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.263013 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0ffb3483-22c6-4d63-b33b-84bda017c261 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.160675 Oct 02 00:59:56.263587 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 256/520] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:56 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:56.549930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:56.550574 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:56.556562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.557636 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.558165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.558974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.559428 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.559865 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.689502 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.697171 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-743eb233-64e9-40ea-8e5c-46eea6c40e8d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1513 microversion: 2.1 time: 0.151094 Oct 02 00:59:56.698449 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 265/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:56 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:57.286445 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:57.287129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:57.294270 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.294750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.295182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.295878 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.296323 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.296751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.432043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:57.440629 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-53a84945-003a-4d0e-98dc-65fa93ca8962 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.158050 Oct 02 00:59:57.441250 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 257/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:57 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:57.722490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:57.723118 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:57.729553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.730238 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.730681 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.731384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.731839 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.732265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.870309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:57.878515 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6b8d2ea4-493b-4554-bb1f-53d2d0a213d6 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1513 microversion: 2.1 time: 0.160727 Oct 02 00:59:57.879107 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 266/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:57 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:58.468484 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:58.469117 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:58.475625 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.476107 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.476537 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.477253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.477703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.478122 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.616673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:58.626015 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-235291ea-7a34-4c90-9d46-ab5bdde0be10 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.161401 Oct 02 00:59:58.626591 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 258/524] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:58 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:58.903627 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:58.904252 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:58.910232 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.910711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.911139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.911817 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.912265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.912686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.943772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:59.045273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:59.052865 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1a6b7de4-7856-4272-8281-fc33406f967d tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1513 microversion: 2.1 time: 0.153572 Oct 02 00:59:59.053459 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 267/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:58 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:59.649165 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:59.649779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:59.656298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.656778 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.657241 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:59.657931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.658384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.658807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:59.795405 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:59.803673 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ae55c554-ac55-44d4-8f46-9f3f863c84b3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.158487 Oct 02 00:59:59.804244 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 259/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:59 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:00.075935 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:00.076477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:00.082372 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.082863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.083302 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.083999 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.084460 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.084884 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.221062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.229497 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9b8d3407-6d93-48b6-ab56-b45e2fd867f4 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1513 microversion: 2.1 time: 0.157114 Oct 02 01:00:00.230071 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 268/527] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:00 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:00.690188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da1ad91-e1f0-434d-9ff8-d6f59224f885", "name": "network-vif-deleted", "tag": "252b634c-bbf0-451d-a002-2cc6b8365da3"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:00.702713 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.703204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.703638 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.720068 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] Creating event network-vif-deleted:252b634c-bbf0-451d-a002-2cc6b8365da3 for instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 on hv-cinder-maste Oct 02 01:00:00.726148 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-91180c52-494c-42d8-8d66-74d61a431a55 req-7cccadf8-152e-4d7b-b5cb-abc23d100fb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039617 Oct 02 01:00:00.726743 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 260/528] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:00.828128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:00.828742 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:00.834762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.835250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.835691 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.836578 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.837070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.837939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.977940 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.986704 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-577d02e0-12d1-47ed-b14d-aac7088c49d2 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.162459 Oct 02 01:00:00.987324 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 269/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:00 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:01.254214 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:01.254911 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:01.261784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.262268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.262705 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.263396 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.263846 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.264357 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.294807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.295285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.295725 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.296167 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lazy-loading 'fault' on Instance uuid 4da1ad91-e1f0-434d-9ff8-d6f59224f885 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:01.343690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abd8f370307422880a120981aa4b755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bf24ea75824896bf7c33c3037e3654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:01.351356 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-093f428e-23fd-44bc-9822-79853b7c7e0f tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 200 len: 1308 microversion: 2.1 time: 0.101408 Oct 02 01:00:01.351919 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 261/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:01 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:02.011295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:02.012470 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:02.018553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.019044 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.019487 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.020798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.021302 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.021758 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.148983 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.158986 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-552e34e5-c4e3-405e-8990-1571b6420d46 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.151938 Oct 02 01:00:02.159566 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 270/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:02 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:02.375616 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:02.376188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] [instance: 4da1ad91-e1f0-434d-9ff8-d6f59224f885] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:02.382562 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.383049 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.383481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.384173 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.384624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.385094 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.399028 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] HTTP exception thrown: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Request method failure captured: Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 HTTP/1.1 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOHy5QoB8yGYUgRsJYeYY-nzximPD9j_1N1sbOe6671a4_8-U017FhOMGDbBqhChVq8Pw8dr0Zmal2EEVHbpfCXYMc-bBbwfzYu_gYY3FC6cjp0ruhfL5ftc-x3KnLQUaytDyodysZjDUwNPM2Wz5cyR8it3elp7l1rqfSz4kX1GHhE Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: c4bf24ea75824896bf7c33c3037e3654 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:00:02.400638 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4bf24ea75824896bf7c33c3037e3654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: c4bf24ea75824896bf7c33c3037e3654 Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103048048 Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-VolumesSnapshotTestJSON-1103048048-project Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 7abd8f370307422880a120981aa4b755 Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103048048-project Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. Oct 02 01:00:02.402819 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '4da1ad91-e1f0-434d-9ff8-d6f59224f885'} Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:02.403677 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. Oct 02 01:00:02.405118 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:02.406245 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] Returning 404 to user: Instance 4da1ad91-e1f0-434d-9ff8-d6f59224f885 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:02.406245 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a3719678-6227-4816-93b7-a07565cc77e8 tempest-VolumesSnapshotTestJSON-1103048048 tempest-VolumesSnapshotTestJSON-1103048048-project] 10.222.0.26 "GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885" status: 404 len: 111 microversion: 2.1 time: 0.030415 Oct 02 01:00:02.406245 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 262/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:02 2022] GET /compute/v2.1/servers/4da1ad91-e1f0-434d-9ff8-d6f59224f885 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:03.184109 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:03.184700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:03.190649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.191136 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.191575 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.192288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.192738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.193201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.326619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.334753 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d94e2b4d-996f-4c4b-8066-0182addee8f1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.154596 Oct 02 01:00:03.335314 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 271/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:03 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:04.358755 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:04.359345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:04.365815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.366332 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.366771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.367482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.367941 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.368377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.500655 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:04.509036 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-452ae2a0-84db-4d61-84a8-7fe74ca26944 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.154651 Oct 02 01:00:04.509635 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 263/534] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:04 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:05.532550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:05.533198 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:05.539087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:05.539567 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:05.540000 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:05.540683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:05.541334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:05.541761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:05.680579 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:05.689424 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-64be652c-5d55-457c-852e-c47c2f7c725b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.160965 Oct 02 01:00:05.689926 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 272/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:05 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:06.711687 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:06.712286 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:06.719775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.720268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.720712 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:06.721449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.721907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.722336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:06.854640 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:06.863289 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e02d33bc-acf5-4a82-8915-f3729587f68c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.155556 Oct 02 01:00:06.863866 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 264/536] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:06 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:07.888318 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:07.889316 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:07.895205 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:07.895691 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:07.896163 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:07.896821 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:07.897341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:07.897774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:08.032961 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:08.041135 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6496edf9-807c-4ff9-8bd3-810f2c77fbc1 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.157690 Oct 02 01:00:08.041708 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 273/537] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:07 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:09.065741 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:09.066482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:09.074713 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.075339 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.075951 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.076923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.077675 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.077891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.219787 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:09.228856 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2c93d179-22cf-47fe-8a4b-568d54dd33cb tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.168369 Oct 02 01:00:09.229815 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 265/538] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:09 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:10.254316 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:10.254941 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:10.263973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.264854 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.266403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.267695 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.268243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.268745 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.434657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:10.443667 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e55c2fbe-fb97-4d20-a4e5-ad301fc89ca8 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.193224 Oct 02 01:00:10.444274 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 274/539] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:10 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:11.468703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.469347 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.476151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.476642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.477124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.477823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.478273 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.478694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.627047 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:11.637150 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a546f296-0b86-4ee8-902f-e8f2d32f981f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.172740 Oct 02 01:00:11.638663 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 266/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:11 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:11.642579 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.643093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.649574 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.650067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.650513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.651225 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.651686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.652118 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.686929 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-148a7457-2859-40e0-a259-f7f11be7dc8d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments/f15e6aec-431c-4cc6-8923-569109c93a67" status: 200 len: 194 microversion: 2.20 time: 0.051094 Oct 02 01:00:11.687727 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 275/541] 10.222.0.26 () {60 vars in 1454 bytes} [Sun Oct 2 01:00:11 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments/f15e6aec-431c-4cc6-8923-569109c93a67 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:00:11.775055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.775548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.781543 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.782027 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.782461 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.783264 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.783783 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.784279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.872770 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lazy-loading 'services' on Instance uuid 0328982f-0ac7-4f28-9aa1-a990a8ddb71f {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:11.954523 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3163695f-3375-418f-9901-a068c320b208 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments/f15e6aec-431c-4cc6-8923-569109c93a67" status: 202 len: 0 microversion: 2.20 time: 0.183175 Oct 02 01:00:11.955134 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 267/542] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Oct 2 01:00:11 2022] DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments/f15e6aec-431c-4cc6-8923-569109c93a67 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:11.965187 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.967972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.975892 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.977266 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.977930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.979036 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.979710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.980176 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.997376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:12.017597 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-52cdd620-fc91-41ab-a71e-0adc778d1894 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056897 Oct 02 01:00:12.018177 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 276/543] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 2 01:00:11 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:12.663259 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:12.664139 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:12.670991 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:12.671488 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:12.672120 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:12.672824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:12.673306 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:12.673732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:12.835605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:12.844220 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-00fbbda9-3d25-4465-8f6f-7f49eb944e0b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.185256 Oct 02 01:00:12.845338 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 268/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:12 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:13.030750 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.032855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.039588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.040121 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.040597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.041397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.041899 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.042376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.073141 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-25d03e87-479e-4579-a576-21cf5feae62b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046507 Oct 02 01:00:13.073703 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 277/545] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 2 01:00:13 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:13.141880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.142404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.148411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.148895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.149369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.150062 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.150520 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.150946 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.175718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:00:13.253962 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f46e4132-c6a5-436a-8910-15a710f9a5f0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 204 len: 0 microversion: 2.20 time: 0.116326 Oct 02 01:00:13.254645 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 269/546] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 2 01:00:13 2022] DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:00:13.262905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.263738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.270467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.270962 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.271404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.272105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.272563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.273017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.406816 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.416009 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.417731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.419009 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-32352c46-94c2-4ad7-9693-460ea2d92ad9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.160196 Oct 02 01:00:13.419615 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 278/547] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:13 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:13.868271 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.869253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.876789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.877101 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.877544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.878251 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.878705 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.879387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.037208 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.047439 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-014daef9-576f-4788-a8b0-f3a7047207ce tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.182128 Oct 02 01:00:14.047439 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 270/548] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:13 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:14.445565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:14.446175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:14.453016 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.453513 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.453953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.454657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.455117 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.455544 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.585161 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.593990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.595467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.596638 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-dc317903-e3d4-439e-b819-61b7e8a4c4ed tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.154987 Oct 02 01:00:14.597234 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 279/549] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:14 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:15.070982 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:15.071732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:15.078831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.079334 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.079774 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.080491 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.080969 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.081453 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.101930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:15.236254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.245919 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7fc99900-4d0c-436a-af9c-b3449ec2cde9 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.178622 Oct 02 01:00:15.246593 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 271/550] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:15 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:15.624493 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:15.625157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:15.631284 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.631870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.632230 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.633010 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.633468 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.634013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.779628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.789841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.791319 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.793539 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4abe56fa-8829-42d3-b3fd-4d569c0086a5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1725 microversion: 2.20 time: 0.175039 Oct 02 01:00:15.794516 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 280/551] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:15 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:16.065517 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0328982f-0ac7-4f28-9aa1-a990a8ddb71f", "name": "network-vif-deleted", "tag": "084a684a-ec3a-474c-b97a-4ab46c878f26"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:16.076163 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.076837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.077122 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.089215 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] Creating event network-vif-deleted:084a684a-ec3a-474c-b97a-4ab46c878f26 for instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f on hv-cinder-maste Oct 02 01:00:16.094247 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-3f80be65-8466-44a1-8b1e-37d9f4a61c0e req-8496d794-9cd4-40b0-81a1-b7605d829e1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Oct 02 01:00:16.094851 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 272/552] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:16.280671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:16.281251 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:16.287620 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.288119 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.288551 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.289326 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.289772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.290366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.453071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:16.475250 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a17bfc49-9301-4250-a22f-381490bb10b5 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.203909 Oct 02 01:00:16.476870 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 281/553] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:16 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:16.822038 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:16.822870 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:16.830171 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.830672 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.831111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.831817 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.832455 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.832891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.866363 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.866760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.867205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.867664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lazy-loading 'fault' on Instance uuid 0328982f-0ac7-4f28-9aa1-a990a8ddb71f {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:16.912674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:16.923452 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:16.925151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:16.926354 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b4b2e438-72da-4d5c-af5a-b61142d2d7c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1372 microversion: 2.20 time: 0.108797 Oct 02 01:00:16.926925 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 273/554] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:16 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:17.509273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:17.510095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:17.512411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=46 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:17.518406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.518919 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.519349 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.520097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.520596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.521054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.675636 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:17.687523 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-dfb8ded7-a2ac-4234-b06c-443c1c04bb00 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1734 microversion: 2.1 time: 0.182841 Oct 02 01:00:17.688757 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 282/555] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:17 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:17.959887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:17.961287 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:17.969634 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.970229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.970743 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.971558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.972092 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.972601 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.012806 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.013527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.013970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.014424 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lazy-loading 'fault' on Instance uuid 0328982f-0ac7-4f28-9aa1-a990a8ddb71f {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:18.059391 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.068450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.069966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.071213 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1c9314cf-a1a9-43be-b86c-7b4b4b9bf8c3 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 200 len: 1372 microversion: 2.20 time: 0.117639 Oct 02 01:00:18.071793 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 274/556] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:17 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:18.711595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:18.714319 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:18.723256 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.724430 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.725305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.726633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.727283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.727714 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.872802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.881360 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e9b2966d-8c76-4184-a33c-39575a649b2b tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1714 microversion: 2.1 time: 0.173514 Oct 02 01:00:18.881932 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 283/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:18 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1714 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:19.004228 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.004863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.011381 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.011864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.012292 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.013594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.014083 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.014555 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.096292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.097042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.100073 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] HTTP exception thrown: Cannot 'detach_volume' instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 while it is in vm_state rescued Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Request method failure captured: Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments/c2deab6f-8a16-4b15-8f7e-b8c447e6ad66 HTTP/1.1 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG8oLRz9jQZMWUi8Kdnwv3QgotX_aLoQACbtOheDunN-3i3-s-XstUJh3zLwmpGowgsqMafEHEhz4FbJhSX6XGwhCQVWESS3GGCthrXQwwZlX0MtUxZDGvsBDTK7OZtI1vIRdNp7EUPvLpRp_9dUBKhvI9crsVZ-Gz9hrf116a1Bm8 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:00:19.101992 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 5ff136440ace420997181fbf11999496 Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:00:19.108425 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Cannot 'detach_volume' instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 while it is in vm_state rescued Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'server_id': '3813c50b-bd9b-4b44-a5f8-42da991274c6', 'id': 'c2deab6f-8a16-4b15-8f7e-b8c447e6ad66'} Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:19.109179 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 while it is in vm_state rescued Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 while it is in vm_state rescued Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.110462 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Returning 409 to user: Cannot 'detach_volume' instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 while it is in vm_state rescued {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:19.111526 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e5e2ebc0-6d04-441a-819a-7263cf53bbfc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments/c2deab6f-8a16-4b15-8f7e-b8c447e6ad66" status: 409 len: 152 microversion: 2.1 time: 0.103512 Oct 02 01:00:19.111526 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 275/558] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:00:18 2022] DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments/c2deab6f-8a16-4b15-8f7e-b8c447e6ad66 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:19.111672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.111672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.111672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.111672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.111946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.111946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.114472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:19.115330 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.123020 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.123449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.123895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.124608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.125103 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.125282 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:00:19.125532 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f HTTP/1.1 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:00:19.126909 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:00:19.128678 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '0328982f-0ac7-4f28-9aa1-a990a8ddb71f'} Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:19.129829 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:00:19.131545 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:00:19.133396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:19.133396 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-593bce44-fbc1-446a-baf3-7831e7e06118 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 404 len: 111 microversion: 2.20 time: 0.035876 Oct 02 01:00:19.133396 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 284/559] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:19 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:00:19.139397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e27c2662-9d4d-4fb6-a56f-c0c65c9088e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '.version_select at 0x7feb048bdc10>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.163558 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e27c2662-9d4d-4fb6-a56f-c0c65c9088e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715284996" status: 204 len: 0 microversion: 2.20 time: 0.029342 Oct 02 01:00:19.164244 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 285/560] 10.222.0.26 () {60 vars in 1262 bytes} [Sun Oct 2 01:00:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715284996 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:00:19.209825 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-26032f68-2b45-4216-b979-2b5af6731fec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/action" status: 202 len: 0 microversion: 2.1 time: 0.100110 Oct 02 01:00:19.210506 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 276/561] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:00:19 2022] POST /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:19.219610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.220874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.228638 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.229298 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.229831 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.230664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.231296 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.232148 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.393328 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:19.408115 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a75e6c9a-faf8-44eb-a37d-a44a6f5790bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1722 microversion: 2.1 time: 0.191745 Oct 02 01:00:19.408695 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 286/562] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:19 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:20.216112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a8df95d2-ad9b-4b8b-b6eb-cf5ab48bd3f7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: .version_select at 0x7feb04812040>, body: {"keypair": {"name": "tempest-keypair-1375427967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXtR6AIdoiPCoXKCev83EA1a8AXrdAeAgAb+KfjS8/w1jfCKJbN7/2PIYTbpjt1v4JTiZr2UAwzGonz2iFLyGMY4bwZlOt2klzi6tCaPq1fPvwTdsxRS7MV/Ctbd2FZFQ=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:20.244710 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-a8df95d2-ad9b-4b8b-b6eb-cf5ab48bd3f7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for project 346545279d0943359a5d495b9dc7f498. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:20.251536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-a8df95d2-ad9b-4b8b-b6eb-cf5ab48bd3f7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for user c21c29da391b4d78a063dbe50057b6eb and project 346545279d0943359a5d495b9dc7f498. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:20.288435 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a8df95d2-ad9b-4b8b-b6eb-cf5ab48bd3f7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.077031 Oct 02 01:00:20.289551 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 277/563] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Oct 2 01:00:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:00:20.443977 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:20.446150 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:20.457944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.458457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.458906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.459630 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.460089 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.461516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.629587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:20.638852 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9bac5327-a6b0-47cf-81f2-1ae088e0869c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1722 microversion: 2.1 time: 0.198796 Oct 02 01:00:20.639442 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 287/564] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:20 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:21.664160 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:21.665447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:21.672996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.673632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.674137 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:21.674944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.676209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.676209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:21.820555 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:21.838921 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-27412866-b002-4780-b4bb-7e2f965fcc3f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1722 microversion: 2.1 time: 0.180001 Oct 02 01:00:21.839627 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 278/565] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:21 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:21.930711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-575312740", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8867ab9-a90e-4dd4-a534-b8cbedc8860c"}], "security_groups": [{"name": "tempest-securitygroup--381853620"}], "key_name": "tempest-keypair-1375427967", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:22.045737 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] validate_networks() for [('a8867ab9-a90e-4dd4-a534-b8cbedc8860c', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:22.679816 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:22.680236 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:22.680711 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:22.681153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:22.681594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:22.691052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.691540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.691983 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.692720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.693209 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.693644 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.711097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for project 346545279d0943359a5d495b9dc7f498. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:22.715232 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Getting quotas for user c21c29da391b4d78a063dbe50057b6eb and project 346545279d0943359a5d495b9dc7f498. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:22.727501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:22.729860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:22.776686 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9da36909-8990-4d44-91b3-756233d336c0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.850304 Oct 02 01:00:22.790746 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:22.791373 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:22.795322 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 288/566] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Oct 2 01:00:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:00:22.847205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.855463 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.857116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.863465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:22.864099 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:22.870467 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6faca239-3594-4bea-9080-c819f04223dc tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1281 microversion: 2.20 time: 0.084330 Oct 02 01:00:22.872751 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 279/567] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:22 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:22.879042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.879553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.879993 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.885322 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.887164 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.891300 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.230994 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:23.241703 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0b74612c-3f14-48a0-b8f5-fa56202e7933 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1728 microversion: 2.1 time: 0.383204 Oct 02 01:00:23.242945 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 289/568] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:22 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1728 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:23.264837 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.265361 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:23.277881 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.284239 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.284856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.285947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.286548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.286924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.435430 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5949600b-8803-49f0-a401-939ed146be7c tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174190 Oct 02 01:00:23.436471 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 280/569] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:23.897715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.899141 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:23.908515 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.910010 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.910800 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.912406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.913555 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.914818 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.046428 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.055690 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.057533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.058837 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-495daaa9-144c-424b-8df5-09de8e84f3d6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1333 microversion: 2.20 time: 0.165158 Oct 02 01:00:24.060282 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 290/570] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1333 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:24.706121 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:24.734275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.734753 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.735235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.764944 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] Creating event network-changed:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 01:00:24.771304 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-b26efea0-5086-4a17-b35f-3aba57f5bab0 req-258d37f7-80c3-41f7-8ac0-f801e46e0ddb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073950 Oct 02 01:00:24.774237 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 281/571] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:25.086470 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.087122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:25.102218 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.103013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.103977 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.104885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.105661 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.106995 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.255572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.274337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.276360 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.277745 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-af620d1f-5483-4334-b271-d7087a7e3ef1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1339 microversion: 2.20 time: 0.195836 Oct 02 01:00:25.279264 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 291/572] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:26.309182 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.310514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:26.334965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.345550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.349369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.350231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.351229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.352131 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.352800 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.819463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.830392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.831968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.832409 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.849618 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] Creating event network-changed:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 01:00:26.863589 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-480d614a-fa5e-40c2-b7e6-6517930863d9 req-38ee0509-213b-42f6-86d9-c9eb1487c0ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047120 Oct 02 01:00:26.865476 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 292/573] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.943133 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.955087 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.963227 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.965994 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-efb298f5-f3d8-4b84-9734-a5bf1bb1db76 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.662308 Oct 02 01:00:26.967471 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 282/574] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:27.139587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.142826 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.150983 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.151834 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.152498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.153888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.154431 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.155054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.189094 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-add4ef04-631c-4686-ae97-0ff5b5ffa4a5 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055038 Oct 02 01:00:27.190288 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 293/575] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:27.310282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.310952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.319338 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.335192 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.335658 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.336438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.336966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.337792 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.382782 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:00:27.554083 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-cc17fb2b-4080-4bfa-8dad-9c40ece4da5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 204 len: 0 microversion: 2.1 time: 0.247674 Oct 02 01:00:27.557434 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 283/576] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:27 2022] DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:27.568351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.568990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.579915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.579915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.579915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.579915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.580883 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.580883 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.764612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:27.777068 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6655e838-416f-42d3-ad8f-2ad207df6231 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1675 microversion: 2.1 time: 0.212023 Oct 02 01:00:27.777068 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 294/577] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.996459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.998235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:28.005501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.006113 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.006664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.007480 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.008038 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.008678 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.183680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.192675 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.194199 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.195822 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1418fff3-e435-4d21-9bb0-351f2e57036a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.204415 Oct 02 01:00:28.196388 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 284/578] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:28.800125 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.801397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:28.810518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.811106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.811619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.813588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.814482 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.814920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.890244 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:28.904576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.905150 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.905786 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.924130 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] Creating event network-changed:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:00:28.931589 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-51e7eccb-1ac5-49ef-a297-3a1e5092e410 req-263baf8a-4506-4a01-93dc-6bb6292d0ce9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046086 Oct 02 01:00:28.932793 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 285/579] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:28.978743 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.987888 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3a22ad48-b43e-4be8-81e8-5dd4f09d4860 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1675 microversion: 2.1 time: 0.192858 Oct 02 01:00:28.988473 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 295/580] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:29.221645 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:29.222636 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:29.229454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.230044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.230549 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.231558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.232056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.232639 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.401269 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.419691 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.422690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.423882 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3fe4d4d8-09e1-4868-9024-ed88e31c5202 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.206964 Oct 02 01:00:29.425637 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 286/581] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:29 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:30.011651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:30.012304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:30.019058 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.019749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.020370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.021295 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.021936 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.022512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.027158 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:30.338351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.348889 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6273f850-915d-45c1-a56b-2ce2804585ad tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1675 microversion: 2.1 time: 0.340799 Oct 02 01:00:30.363429 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 296/582] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:30 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1675 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:30.451380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:30.453245 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:30.461950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.462899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.463584 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.464534 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.465255 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.466039 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.769883 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.780574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.786404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.788206 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b9034ac7-98e7-4d9b-866e-048983d32a16 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.343290 Oct 02 01:00:30.789648 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 287/583] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:30 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:31.089912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b015e40c-98d7-4fec-98e1-ad84b496767b", "name": "network-vif-deleted", "tag": "a3490b59-f6e1-446d-9de3-9df384b29702"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:31.111512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.112559 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.113436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.150690 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] Creating event network-vif-deleted:a3490b59-f6e1-446d-9de3-9df384b29702 for instance b015e40c-98d7-4fec-98e1-ad84b496767b on hv-cinder-maste Oct 02 01:00:31.163269 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-00f739b2-e577-48c4-ad68-e15f3701a8df req-ff0390a5-cb23-4125-9398-ce2e25b8cceb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077955 Oct 02 01:00:31.165711 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 297/584] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:31.380329 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:31.381187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:31.398467 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.398980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.399427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.400152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.400630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.401092 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.479452 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.480006 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.480447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.481040 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'fault' on Instance uuid b015e40c-98d7-4fec-98e1-ad84b496767b {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:31.568910 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.572506 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:31.586187 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a7b6cb00-261e-46db-8ce7-4ee26c8000ae tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 200 len: 1328 microversion: 2.1 time: 0.212240 Oct 02 01:00:31.588463 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 288/585] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:31 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:31.822095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:31.823581 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:31.837372 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.840072 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.841833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.851819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.852641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.853310 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.429766 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.438423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.440191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.441742 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6293551c-bd67-4dae-bdaa-ec6c159829e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.629735 Oct 02 01:00:32.442315 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 298/586] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:31 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:32.615247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.616610 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:32.626193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.627043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.627708 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.629387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.630173 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.630925 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.657516 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b HTTP/1.1 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:00:32.659581 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:00:32.660917 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'b015e40c-98d7-4fec-98e1-ad84b496767b'} Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:32.661870 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:00:32.663333 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.665664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:32.667754 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8d967e5a-a63a-4d16-a09e-e55d64c9bd9e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 404 len: 111 microversion: 2.1 time: 0.060089 Oct 02 01:00:32.672395 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 289/587] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:00:32.681761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1cfa3663-1a05-448e-9b81-507dfda798d6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '.version_select at 0x7feb048bdf70>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.703433 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:32.723246 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1cfa3663-1a05-448e-9b81-507dfda798d6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861427240" status: 202 len: 0 microversion: 2.1 time: 0.049909 Oct 02 01:00:32.724151 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 299/588] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861427240 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:33.470947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.471582 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:33.475265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=6 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:33.485413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.485988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.487331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:33.488875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.491085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.492960 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:33.759945 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:33.765503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7b93ff3e-0b12-4c5f-ab99-fae3737fb546 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: .version_select at 0x7feb05fa4700>, body: {"keypair": {"name": "tempest-keypair-935641085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhcZIs4hqtIDmcxMhGoX0PstNPm1jiefJ/qxiB0Z5Q45tUVN55iVTv3Ft2ALs1lQ942JzIs21JZZ7mhJWK0TUoj7MbMmE174snDka+pZS7o8tj2bkblpgn1yoINJOy1pQ=="}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.785292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-7b93ff3e-0b12-4c5f-ab99-fae3737fb546 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:33.790290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.803569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.807116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.808830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-7b93ff3e-0b12-4c5f-ab99-fae3737fb546 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for user 1f392d3cac0149b09d4f83e83a930298 and project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:33.812652 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d7c5bd2f-0d3a-410c-be1c-d5cfcebc2d86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.345667 Oct 02 01:00:33.814966 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 290/589] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:33.843304 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7b93ff3e-0b12-4c5f-ab99-fae3737fb546 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083933 Oct 02 01:00:33.849702 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 300/590] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:00:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:34.846990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:34.847728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:34.865388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.866229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.867364 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.869441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.870764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.871803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.898479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b2c66b51-2122-4dac-bcab-a60e26a7a64f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Action: 'create', calling method: .version_select at 0x7feb04897af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-539083247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2CxhoaeakQ2VfPihr3rgE2v1nTJwTM0PVDrJBowD4K3sbowHczpywIb1JDq3wWLI41RyjE/EXVT9X72s1mZVlCvT+f0lzUt6dO9sbUDLj6C2DtPkw8vHXuXiXNFdf72A=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:34.942407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-b2c66b51-2122-4dac-bcab-a60e26a7a64f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Getting quotas for project a79ddf414b9f4b0aa6a09cd54c747e08. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:34.950904 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-b2c66b51-2122-4dac-bcab-a60e26a7a64f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Getting quotas for user 9d9b96e5011b41fe8a496252e77f4be6 and project a79ddf414b9f4b0aa6a09cd54c747e08. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:35.008882 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b2c66b51-2122-4dac-bcab-a60e26a7a64f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.325334 Oct 02 01:00:35.010009 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 291/591] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:00:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:35.083932 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.104439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.109514 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.111905 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-34756bcd-a1c2-4baf-966e-92604bc8290d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.270525 Oct 02 01:00:35.113856 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 301/592] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:34 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:35.530917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1864340380", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08544471-7a68-4aa2-a2bf-b9cbb7450fd5"}], "security_groups": [{"name": "tempest-securitygroup--96130715"}], "key_name": "tempest-keypair-935641085", "user_data": "}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:35.690827 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] validate_networks() for [('08544471-7a68-4aa2-a2bf-b9cbb7450fd5', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:36.140607 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:36.141619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:36.150955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.151560 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.152224 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.153241 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.153931 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.154498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.182560 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:36.183036 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:36.183433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:36.184996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:36.185360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:36.198038 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.200969 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.201551 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.203855 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.204495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.205957 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.229557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:36.234964 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Getting quotas for user 1f392d3cac0149b09d4f83e83a930298 and project ef3cd95384ef44d58659e77a1cd99e05. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:36.257288 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:36.259500 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:36.335391 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ce01dfed-7ad5-4c22-b308-f21e07987131 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.809142 Oct 02 01:00:36.336956 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 292/593] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:00:36.343359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.355946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.370375 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.371981 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2cce4021-943d-4f8c-9282-400354162509 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.235538 Oct 02 01:00:36.372767 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 302/594] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:36 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:36.373307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-72dd83b2-3cca-4975-9f08-c74520e90449 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:36.375830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-72dd83b2-3cca-4975-9f08-c74520e90449 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:36.449296 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-72dd83b2-3cca-4975-9f08-c74520e90449 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.458278 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-72dd83b2-3cca-4975-9f08-c74520e90449 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1237 microversion: 2.1 time: 0.105529 Oct 02 01:00:36.458844 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 293/595] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:36 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:37.236990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "name": "network-vif-plugged", "status": "completed", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:37.260613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.261166 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.261606 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.276826 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] Creating event network-vif-plugged:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:00:37.283258 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-9a18cfe9-8e3d-4582-970d-e1f7dfb91a33 req-07037fa8-8713-4080-9c9f-ac71e484716e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050395 Oct 02 01:00:37.283932 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 303/596] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:37.400503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:37.401577 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:37.410056 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.410553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.411205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.411923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.413041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.413843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.483915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:37.484917 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:37.492358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.492782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.493664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.494404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.495092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.495676 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.577619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.585289 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-21f13d93-4858-413a-8447-c40aae639e56 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1289 microversion: 2.1 time: 0.106803 Oct 02 01:00:37.585866 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 304/597] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:37 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:37.602054 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.611336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.612784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.613983 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-149d8699-908d-417b-bb01-37aefc8f7d63 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.217841 Oct 02 01:00:37.614839 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 294/598] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:37 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:38.610026 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:38.610641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:38.616657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.617162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.617596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.618538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.618992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.619415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.640736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:38.641482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:38.649110 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.649674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.650119 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.650829 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.651341 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.651767 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.690688 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.697935 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1132e10b-ec39-491e-9f89-21f3cfdfc751 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1295 microversion: 2.1 time: 0.092399 Oct 02 01:00:38.698549 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 305/599] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:38 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:38.847326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.863503 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.865424 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.866917 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d318df3b-7e76-4066-b962-2ad4b4b7d92e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1406 microversion: 2.20 time: 0.231031 Oct 02 01:00:38.884801 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 295/600] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:38 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:39.726443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:39.727623 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:39.737388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.738605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.740730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.746944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.748171 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.748814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.892824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:39.894245 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:39.901105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.901824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.902581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.903899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.904566 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.905298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.075013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.095208 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c03b183b-dc12-422a-bdfc-85f00ee2959b tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.377297 Oct 02 01:00:40.096129 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 306/601] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:39 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:40.220850 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.230316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.233996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.235562 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bf3538dc-25ed-4ae6-a1e9-b13ab69abb2c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1598 microversion: 2.20 time: 0.347335 Oct 02 01:00:40.236327 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 296/602] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:39 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1598 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:40.262084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:40.262594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:40.269840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.270725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.271169 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.271882 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.272339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.272768 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.394297 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-62043cc6-b5d3-4bd8-8655-c72f09de6676 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136186 Oct 02 01:00:40.395170 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 307/603] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Oct 2 01:00:40 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:41.121827 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:41.122451 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:41.129379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.129871 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.130530 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.131460 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.131916 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.132529 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.175803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54569b08-ca2c-4cda-a7be-92731fac9759", "tag": "914a24fd-cc04-42d2-970d-322c736ede19"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:41.193176 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.194859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.195468 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.224859 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] Creating event network-changed:914a24fd-cc04-42d2-970d-322c736ede19 for instance 54569b08-ca2c-4cda-a7be-92731fac9759 on hv-cinder-maste Oct 02 01:00:41.230159 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-550b2215-711c-4308-8ebc-1b9dc7f93289 req-4fb77be7-03dc-4a25-a381-8ba153994914 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057862 Oct 02 01:00:41.231087 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 308/604] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:41.714122 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.722664 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-eac88c8a-ef7a-4b38-870b-0a397da97048 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.605868 Oct 02 01:00:41.723241 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 297/605] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:41 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:42.749438 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.750970 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:42.757778 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.758278 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.758722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.759729 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.760192 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.760657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.895174 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.907744 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8dffc8ee-f9e2-4c90-bfd2-af98ca0ae7b3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.163846 Oct 02 01:00:42.908442 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 309/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:43.264747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:43.275053 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.275543 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.275985 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.288681 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] Creating event network-changed:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:00:43.295946 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-b2e57e7d-dec9-465f-a4e0-50df5c606c42 req-6a7f6d60-7d40-4084-8189-19d6e1bbea89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Oct 02 01:00:43.297300 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 298/607] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:43.931843 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:43.933082 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:43.939712 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=4 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:43.942281 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.942975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.943572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.945107 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.946199 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.947388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.102578 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:44.111640 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6bfbc103-8a63-4a18-8821-88c254ce378c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.183594 Oct 02 01:00:44.112238 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 310/608] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:43 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:45.137830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.138442 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:45.145207 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.145846 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.146354 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.147153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.147608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.148031 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.290955 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:45.299127 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-775af32e-d5a9-409c-924c-33a078eb389c tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.167098 Oct 02 01:00:45.299715 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 299/609] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:46.322917 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:46.323526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:46.330091 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:46.330589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:46.331031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.331827 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:46.332291 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:46.332721 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.466038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.474036 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-832e6ddd-b0dc-4ef0-898f-2d833f3b0d5a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.155150 Oct 02 01:00:46.474712 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 311/610] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:46 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:47.238342 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54569b08-ca2c-4cda-a7be-92731fac9759", "name": "network-vif-plugged", "status": "completed", "tag": "914a24fd-cc04-42d2-970d-322c736ede19"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:47.244268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:47.244979 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=12 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:47.251613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.252115 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.252548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.265095 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] Creating event network-vif-plugged:914a24fd-cc04-42d2-970d-322c736ede19 for instance 54569b08-ca2c-4cda-a7be-92731fac9759 on hv-cinder-maste Oct 02 01:00:47.269943 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-35cf91b6-e0af-48f7-95b6-fe4cbf576020 req-2519b627-aeb9-4208-8295-67df42892824 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035320 Oct 02 01:00:47.270537 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 300/611] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:47.497700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.498483 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.505126 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.505633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.506069 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.506790 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.507255 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.507679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.647281 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:47.655007 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3c36398b-49c1-41fd-8198-73209ed90cc8 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.162277 Oct 02 01:00:47.655574 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 312/612] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:48.678906 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:48.679598 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:48.686390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:48.686874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:48.687307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:48.687994 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:48.688441 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:48.688864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:48.822070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:48.831061 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1ed7a8ed-2edd-4e7b-8bb9-3c2e696c9b72 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1361 microversion: 2.1 time: 0.156813 Oct 02 01:00:48.831633 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 301/613] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:48 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:49.692442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1166884640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-539083247", "security_groups": [{"name": "tempest-secgroup-smoke-422702861"}], "networks": [{"uuid": "3e06aa28-a523-45c1-9b19-ef8434b71e57"}], "block_device_mapping_v2": [{"uuid": "de5b837f-80ba-454a-bfa4-227b8d70af90", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.703229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:49.810346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] validate_networks() for [('3e06aa28-a523-45c1-9b19-ef8434b71e57', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:49.853957 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:49.854715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:49.861446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.861943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.862386 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:49.863086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.863547 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.863978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.064004 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:50.072990 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5b54df1d-b741-4e13-9ebd-26706004095e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1548 microversion: 2.1 time: 0.222872 Oct 02 01:00:50.073654 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 302/614] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:49 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:50.096833 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:50.097427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:50.103314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.103845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.104303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.105116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.105460 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.105962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.210734 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b76d39e3-4d16-419f-b9a4-908e93eae4a4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118042 Oct 02 01:00:50.211326 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 303/615] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:00:50 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:50.306133 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:50.306818 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:50.307326 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:50.307825 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:50.308303 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:50.317333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.317815 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.318246 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.318968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.319416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.319836 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.338751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Getting quotas for project a79ddf414b9f4b0aa6a09cd54c747e08. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:50.343772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Getting quotas for user 9d9b96e5011b41fe8a496252e77f4be6 and project a79ddf414b9f4b0aa6a09cd54c747e08. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:50.404275 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:50.406464 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de5b837f-80ba-454a-bfa4-227b8d70af90',volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:50.552814 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1a6164a3-c5f5-4305-8414-c0de8fb273c5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.864102 Oct 02 01:00:50.553657 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 313/616] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:00:50.565972 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f48e57a2-7c05-4e1c-b121-9fb693d6b747 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:50.567213 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f48e57a2-7c05-4e1c-b121-9fb693d6b747 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:50.628791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f48e57a2-7c05-4e1c-b121-9fb693d6b747 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:50.636640 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f48e57a2-7c05-4e1c-b121-9fb693d6b747 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1088 microversion: 2.1 time: 0.074424 Oct 02 01:00:50.637344 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 304/617] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:50 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:51.224053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54569b08-ca2c-4cda-a7be-92731fac9759", "tag": "914a24fd-cc04-42d2-970d-322c736ede19"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:51.237930 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:51.238430 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:51.238864 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:51.251579 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] Creating event network-changed:914a24fd-cc04-42d2-970d-322c736ede19 for instance 54569b08-ca2c-4cda-a7be-92731fac9759 on hv-cinder-maste Oct 02 01:00:51.258068 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-469be692-8430-48e7-949b-c943fee53c14 req-1b13e827-bca2-4aef-8843-5e5b05e13827 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039086 Oct 02 01:00:51.258668 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 314/618] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:51.659762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:51.660383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:51.668091 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:51.669042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:51.669489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:51.670198 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:51.670667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:51.671098 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:51.733494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:51.741079 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-39bac11e-672f-49ef-bd0f-23743794c5dc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1186 microversion: 2.1 time: 0.085193 Oct 02 01:00:51.741647 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 305/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:51 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:52.767731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:52.769009 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:52.780738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.781294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.781917 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.782805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.783417 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.784001 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:53.010500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:53.019506 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e2e031b2-e58f-4dbc-8561-278a742cd154 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.259377 Oct 02 01:00:53.020095 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 315/620] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:52 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:53.550494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:53.565211 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:53.566011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:53.566934 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:53.581402 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] Creating event network-changed:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:00:53.587397 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-85f41592-f193-4d56-a239-f4e3b7e1b3bb req-b8108868-7f1e-4951-abcf-8211fa05b54f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041871 Oct 02 01:00:53.588465 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 306/621] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:54.044666 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:54.045376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:54.051675 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:54.052345 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:54.052964 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:54.053919 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:54.054625 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:54.055223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:54.201418 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:54.209666 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-af7b9e44-c4a0-4815-b43b-019feb6a28ea tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.170500 Oct 02 01:00:54.210215 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 316/622] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:54 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:55.236471 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:55.238605 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:55.244985 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.246285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.246730 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.247478 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.247931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.248371 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.497554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:55.505962 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-17ca6085-18c0-4fb8-9bbf-4cc73a7b9727 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.274537 Oct 02 01:00:55.506748 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 307/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:55 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:56.533841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:56.534647 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:56.541845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:56.543003 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:56.543530 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:56.544508 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:56.545247 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:56.545831 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:56.689285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:56.698438 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-16cfd373-5a20-4a26-9702-548b316e6683 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.169035 Oct 02 01:00:56.699240 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 317/624] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:56 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:57.722610 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:57.723404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:57.725867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:57.731617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:57.732109 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:57.732542 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:57.733267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:57.733720 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:57.734142 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:57.893560 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:57.902209 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e4a1dd6c-fadf-495c-82ba-63c63428ba4b tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.183147 Oct 02 01:00:57.902542 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 308/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:57 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:58.925826 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:58.926441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:58.933084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:58.933935 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:58.934466 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:58.935293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:58.935937 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:58.936505 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:58.954160 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:59.078173 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:59.086007 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-278f07c8-a67a-420a-a48d-463fc2007046 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.164060 Oct 02 01:00:59.086555 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 318/626] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:58 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:59.338579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "name": "network-vif-plugged", "status": "completed", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:59.349877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:59.350369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:59.350805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:59.363637 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] Creating event network-vif-plugged:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:00:59.368972 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-5b913462-c33a-4d6e-9c2e-cf50d6f68aca req-867ba4f8-e955-44ea-a7f2-a92ee6f55a56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Oct 02 01:00:59.369567 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 309/627] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.110426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:00.111244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:00.119172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.119670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.120285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.121341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.121801 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.122233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.280339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:00.290528 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c6cdd91f-e9ae-49c2-ba3c-b1e548ed2f62 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1259 microversion: 2.1 time: 0.185679 Oct 02 01:01:00.291123 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 319/628] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:00 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:01.311304 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.315931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.316637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:01.323348 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.323977 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.324421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.325152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.325626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.326045 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.465196 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:01.474184 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aeb7ad32-730d-41b0-9edd-821b0ff083c7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1444 microversion: 2.1 time: 0.164484 Oct 02 01:01:01.474856 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 310/629] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:01 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:01.498260 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.498891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:01.500782 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.501500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.506479 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.509229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.509229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.509229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.509229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.509764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.655503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:01.663690 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f6adf0db-d130-44e8-9e9c-aad2142af0b8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1444 microversion: 2.1 time: 0.169580 Oct 02 01:01:01.664298 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 320/630] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:01 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:02.692692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.693298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:02.701599 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.702151 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.702633 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.703589 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.704279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.704811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.710109 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=89 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:02.794383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'services' on Instance uuid 3813c50b-bd9b-4b44-a5f8-42da991274c6 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:02.873155 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-499681c5-aab5-4762-a07d-0216643340b7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments/c2deab6f-8a16-4b15-8f7e-b8c447e6ad66" status: 202 len: 0 microversion: 2.1 time: 0.184530 Oct 02 01:01:02.873776 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 311/631] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:01:02 2022] DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments/c2deab6f-8a16-4b15-8f7e-b8c447e6ad66 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:02.882403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.885384 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:02.893366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.893830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.894488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.895302 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.895753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.896229 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.936727 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cf3b35e4-565a-4e36-b065-d73fe9f620bc tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058437 Oct 02 01:01:02.937278 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 321/632] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:02 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:03.514174 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:03.525750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.537377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.538075 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.561465 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] Creating event network-changed:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:01:03.566655 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-64a53614-7351-4f01-b337-4b271861d3a9 req-45a1982c-8078-44ca-9a53-088c1fa88aa6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056506 Oct 02 01:01:03.567418 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 312/633] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:03.950439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.952911 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:03.959453 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.959955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.960400 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.961232 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.961876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.962651 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.999269 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0a64dc29-f0a6-469a-b5b5-506f42edfb08 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053375 Oct 02 01:01:04.000606 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 322/634] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:03 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.078545 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.079701 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.086147 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.086804 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.087249 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.087959 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.088641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.089084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.123054 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:04.227482 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4b8469ed-94ed-4e9d-87f2-7fddaf56e7fa tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 204 len: 0 microversion: 2.1 time: 0.153684 Oct 02 01:01:04.231657 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 313/635] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:04 2022] DELETE /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:04.241269 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.242219 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.254285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.255087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.255709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.256835 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.257540 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.258304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.399554 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:04.408516 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-58a05fda-a5be-4a24-b417-185c7d9c48bf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1688 microversion: 2.1 time: 0.171299 Oct 02 01:01:04.409847 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 323/636] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:05.433257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:05.434098 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:05.441235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:05.441789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:05.442264 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:05.443029 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:05.443574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:05.444014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:05.590981 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:05.600350 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-716f2172-258b-4729-b966-ebebd454981a tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1688 microversion: 2.1 time: 0.171568 Oct 02 01:01:05.601053 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 314/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:05 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:06.627533 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:06.628237 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:06.636281 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.637294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.637771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.638606 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.639156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.639638 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.788605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:06.797831 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6c77ec2d-dbb9-48aa-8309-0c4505a24fda tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1688 microversion: 2.1 time: 0.174775 Oct 02 01:01:06.798490 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 324/638] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:06 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:07.823899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.824492 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:07.831241 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:07.831733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:07.832176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:07.832877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:07.833372 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:07.833833 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.022554 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:08.031324 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-95817ebd-ef63-4af4-b5c0-28dcb80678ed tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1688 microversion: 2.1 time: 0.211487 Oct 02 01:01:08.031895 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 315/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:07 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:09.054714 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.055361 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:09.061709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.062202 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.062639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.063378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.063802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.064227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.175811 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3813c50b-bd9b-4b44-a5f8-42da991274c6", "name": "network-vif-deleted", "tag": "b904c361-92b8-4c5a-8763-ddd938ee73be"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:09.191037 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.191524 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.191958 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.204145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:09.205476 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] Creating event network-vif-deleted:b904c361-92b8-4c5a-8763-ddd938ee73be for instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 on hv-cinder-maste Oct 02 01:01:09.211494 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-d06e3173-dbc2-4296-a572-dcaea5c754bb req-3befa065-8d89-4cfd-bfc4-7a2d281ddb9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Oct 02 01:01:09.212875 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 316/640] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:09.215757 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1b7f81c8-b967-4ff8-b899-139108508971 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1620 microversion: 2.1 time: 0.164822 Oct 02 01:01:09.216410 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 325/641] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:09 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1620 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:10.244439 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:10.246563 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:10.256204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.256716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.257208 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.257956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.258420 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.258859 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.313959 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.314459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.314907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.315502 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'fault' on Instance uuid 3813c50b-bd9b-4b44-a5f8-42da991274c6 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:10.365943 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:10.374196 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ac49c99a-ca0c-4f77-8d74-73de115307a0 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 200 len: 1335 microversion: 2.1 time: 0.135048 Oct 02 01:01:10.375190 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 317/642] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:10 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 1335 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:11.398644 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.399273 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 3813c50b-bd9b-4b44-a5f8-42da991274c6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:11.405855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:11.406374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:11.406796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:11.407511 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:11.407969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:11.408394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:11.432868 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] HTTP exception thrown: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Request method failure captured: Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 HTTP/1.1 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG8oLRz9jQZMWUi8Kdnwv3QgotX_aLoQACbtOheDunN-3i3-s-XstUJh3zLwmpGowgsqMafEHEhz4FbJhSX6XGwhCQVWESS3GGCthrXQwwZlX0MtUxZDGvsBDTK7OZtI1vIRdNp7EUPvLpRp_9dUBKhvI9crsVZ-Gz9hrf116a1Bm8 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:01:11.435092 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 5ff136440ace420997181fbf11999496 Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. Oct 02 01:01:11.436752 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '3813c50b-bd9b-4b44-a5f8-42da991274c6'} Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:11.437728 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. Oct 02 01:01:11.439240 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.440710 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Returning 404 to user: Instance 3813c50b-bd9b-4b44-a5f8-42da991274c6 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:11.440710 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bbcc0bf9-62d0-4c9b-9db7-2015e1886b65 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6" status: 404 len: 111 microversion: 2.1 time: 0.041837 Oct 02 01:01:11.440710 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 326/643] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:11 2022] GET /compute/v2.1/servers/3813c50b-bd9b-4b44-a5f8-42da991274c6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:11.445562 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8589f61c-aa26-42f4-a4f0-1ab1146bb1da tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '.version_select at 0x7feb047808b0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.466664 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8589f61c-aa26-42f4-a4f0-1ab1146bb1da tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693068305" status: 202 len: 0 microversion: 2.1 time: 0.024982 Oct 02 01:01:11.467252 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 318/644] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693068305 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:01:14.407445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.407950 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:14.414296 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.414786 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.415238 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.415940 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.416897 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.417357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.444143 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:14.524649 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-b92b6b09-2a91-41aa-8c9e-3c76bf02f6ec tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 204 len: 0 microversion: 2.1 time: 0.120871 Oct 02 01:01:14.525277 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 327/645] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:14.534828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.535449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:14.549242 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.549747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.550195 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.550909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.551373 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.551803 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.685004 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:14.693100 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e0084dfc-2c4b-416b-b726-92506cc6ef56 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1506 microversion: 2.1 time: 0.162725 Oct 02 01:01:14.693670 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 319/646] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:14 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:15.717678 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.718278 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:15.724191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.724684 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.725164 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.725858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.726317 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.726752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.863914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.872559 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-11efc1ab-188d-45ad-8e43-312e39078393 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1506 microversion: 2.1 time: 0.159919 Oct 02 01:01:15.873140 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 328/647] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:16.895339 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:16.895902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:16.903198 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.903685 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.904125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.904821 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.905306 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.905734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:17.033980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:17.041835 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f887b16a-9dca-48da-974e-3718a6211154 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1506 microversion: 2.1 time: 0.150659 Oct 02 01:01:17.042408 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 320/648] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:16 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:17.800683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76ff8dd-f683-4998-93ca-4909712234a6", "name": "network-vif-deleted", "tag": "985125fa-5191-425d-9bff-098da17e4a16"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:17.819311 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:17.820194 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:17.821009 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:17.838923 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] Creating event network-vif-deleted:985125fa-5191-425d-9bff-098da17e4a16 for instance e76ff8dd-f683-4998-93ca-4909712234a6 on hv-cinder-maste Oct 02 01:01:17.845937 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-a41783a9-c015-4b74-8899-a1c355f15c7b req-88df9d12-efaf-4217-9913-3a2ee7f5cebc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053643 Oct 02 01:01:17.847588 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 329/649] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:18.065358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:18.066028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:18.073077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.073575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.074024 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.074739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.075205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.075642 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.116394 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.116780 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.117520 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.118014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'fault' on Instance uuid e76ff8dd-f683-4998-93ca-4909712234a6 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:18.163690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:18.171835 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ad08e4a5-efe0-4680-afff-833e6b0513f7 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 200 len: 1310 microversion: 2.1 time: 0.110434 Oct 02 01:01:18.172411 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 321/650] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:18 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:19.195947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.196649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: e76ff8dd-f683-4998-93ca-4909712234a6] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:19.203145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.203642 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.204084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.204795 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.205284 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.205716 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.219663 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] HTTP exception thrown: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Request method failure captured: Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 HTTP/1.1 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG8oLRz9jQZMWUi8Kdnwv3QgotX_aLoQACbtOheDunN-3i3-s-XstUJh3zLwmpGowgsqMafEHEhz4FbJhSX6XGwhCQVWESS3GGCthrXQwwZlX0MtUxZDGvsBDTK7OZtI1vIRdNp7EUPvLpRp_9dUBKhvI9crsVZ-Gz9hrf116a1Bm8 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:01:19.221357 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 5ff136440ace420997181fbf11999496 Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. Oct 02 01:01:19.222930 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'e76ff8dd-f683-4998-93ca-4909712234a6'} Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:19.223810 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. Oct 02 01:01:19.225329 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:19.226633 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Returning 404 to user: Instance e76ff8dd-f683-4998-93ca-4909712234a6 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:19.226633 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3595e104-b5cd-4875-8250-78c091523255 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6" status: 404 len: 111 microversion: 2.1 time: 0.031560 Oct 02 01:01:19.226633 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 330/651] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:19 2022] GET /compute/v2.1/servers/e76ff8dd-f683-4998-93ca-4909712234a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:19.232446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.233067 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:19.239374 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.239860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.240297 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.241011 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.241474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.241900 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.268069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:19.353248 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7c164770-8d4a-4003-a98f-3820ce32002e tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 204 len: 0 microversion: 2.1 time: 0.124888 Oct 02 01:01:19.355396 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 322/652] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:19 2022] DELETE /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:19.362957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.363569 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:19.370660 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.371153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.371587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.372286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.372740 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.373191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.515857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:19.523759 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8c83495d-32fd-4ce5-a643-dd42c63f66f3 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.164633 Oct 02 01:01:19.524340 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 331/653] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:19 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:20.414136 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:20.414806 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:20.422282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.422776 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.423216 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.423924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.424383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.424809 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.453087 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d0944e83-ac6c-4991-868f-111c4cd37390 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/ips" status: 200 len: 152 microversion: 2.20 time: 0.044178 Oct 02 01:01:20.453671 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 323/654] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Oct 2 01:01:20 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:20.548601 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:20.549643 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:20.551896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:20.558022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.558515 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.558963 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.559677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.560143 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.560569 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.747675 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:20.763304 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2ddd4068-25ca-46fd-800b-06d3fbd94246 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.218898 Oct 02 01:01:20.764454 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 332/655] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:20 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:21.796201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:21.796889 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:21.803528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.804023 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.804465 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.806155 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.808254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.808254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.987343 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:22.001313 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1fbb3e41-731f-44ca-98ea-efdf82320026 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.210223 Oct 02 01:01:22.001921 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 324/656] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:21 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:23.026065 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.026832 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.033163 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.033658 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.034097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.034811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.035274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.035701 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.188144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.196729 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c4d5faeb-4e92-483e-81a6-e855907d08cf tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1522 microversion: 2.1 time: 0.175707 Oct 02 01:01:23.197668 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 333/657] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:23.347118 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:23.348002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.355319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.355821 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.356269 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.357018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.357591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.358021 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.393849 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lazy-loading 'flavor' on Instance uuid ed0d507f-f4fb-48bc-ac01-74584f97ba88 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:23.396438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:23.617913 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e584c3cf-55da-4c7d-8f1d-4ca654524a86 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/action" status: 202 len: 0 microversion: 2.20 time: 0.274364 Oct 02 01:01:23.617913 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 325/658] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 2 01:01:23 2022] POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:23.627869 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.628134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.634340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.635939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.636636 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.637412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.637881 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.638307 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.823102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da7db91-0f99-4f2a-8d76-aa6544f7656f", "name": "network-vif-deleted", "tag": "d280ff3c-bcab-4daf-bc79-66b95b2e94ba"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:23.834519 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.835063 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.835701 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.849055 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] Creating event network-vif-deleted:d280ff3c-bcab-4daf-bc79-66b95b2e94ba for instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f on hv-cinder-maste Oct 02 01:01:23.855620 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-e77a3273-9a31-48ad-8761-13f8e9495afe req-08d41dba-8fc4-4768-8f74-7b8d167422b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036584 Oct 02 01:01:23.856802 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 326/659] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:23.874771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.883170 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.884668 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.885915 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-057c2852-82a4-4a9a-8aba-3f505010b26e tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.262554 Oct 02 01:01:23.886668 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 334/660] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:24.224022 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:24.224736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:24.232017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.232514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.232984 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.233704 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.234168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.234600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.271641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.272146 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.272590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.273490 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lazy-loading 'fault' on Instance uuid 8da7db91-0f99-4f2a-8d76-aa6544f7656f {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:24.316148 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff136440ace420997181fbf11999496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d154735aabe4f2b966f44f5d2ce92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:24.325096 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-56c76429-72f6-498b-9880-f09597f7676f tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 200 len: 1312 microversion: 2.1 time: 0.105379 Oct 02 01:01:24.325695 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 327/661] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:24 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:24.921971 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:24.922614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:24.928768 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.929294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.929736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.930460 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.930920 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.931397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.946716 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:25.097037 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.105850 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.107309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.108601 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5cd74d59-c5f4-441a-91ba-1a0ccf9a2b1c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.190539 Oct 02 01:01:25.109234 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 335/662] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:24 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:25.349496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:25.350052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] [instance: 8da7db91-0f99-4f2a-8d76-aa6544f7656f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:25.356858 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.357380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.357828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.358532 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.358978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.359477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.374823 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] HTTP exception thrown: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Request method failure captured: Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f HTTP/1.1 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG8oLRz9jQZMWUi8Kdnwv3QgotX_aLoQACbtOheDunN-3i3-s-XstUJh3zLwmpGowgsqMafEHEhz4FbJhSX6XGwhCQVWESS3GGCthrXQwwZlX0MtUxZDGvsBDTK7OZtI1vIRdNp7EUPvLpRp_9dUBKhvI9crsVZ-Gz9hrf116a1Bm8 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:01:25.376514 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d154735aabe4f2b966f44f5d2ce92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 9d154735aabe4f2b966f44f5d2ce92d6 Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1115674102 Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 5ff136440ace420997181fbf11999496 Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1115674102-project Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. Oct 02 01:01:25.378138 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '8da7db91-0f99-4f2a-8d76-aa6544f7656f'} Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:25.378959 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. Oct 02 01:01:25.380442 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:01:25.381831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] Returning 404 to user: Instance 8da7db91-0f99-4f2a-8d76-aa6544f7656f could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:25.381831 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c599eb96-bd7b-4f31-9ce4-77dee3b87c44 tempest-ServerRescueNegativeTestJSON-1115674102 tempest-ServerRescueNegativeTestJSON-1115674102-project] 10.222.0.26 "GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 02 01:01:25.381831 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 328/663] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:25 2022] GET /compute/v2.1/servers/8da7db91-0f99-4f2a-8d76-aa6544f7656f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:26.269708 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.270854 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.281793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.282674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.283498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.284756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.285418 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.286038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.454100 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.471323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.473761 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.476631 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1ba06fac-16c9-4f93-871a-e0f60f225284 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.345191 Oct 02 01:01:26.481417 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 336/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:27.524220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.527527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.537061 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.537942 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.538839 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.539771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.541714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.542463 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.781482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.794508 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.798420 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.801060 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b0d8f847-6a49-4e36-b837-766fab83bb34 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.284152 Oct 02 01:01:27.802188 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 329/665] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:28.834184 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.835031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.843253 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.844122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.844728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.846095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.847076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.848006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.107542 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.122161 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.123655 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.124845 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-42e3d20a-8a5c-4b66-98a7-6289e0782324 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.295033 Oct 02 01:01:29.125458 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 337/666] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:30.153377 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:30.155070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:30.157459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.163248 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.163719 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.164156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.164868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.165419 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.165856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.321290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.330594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.332059 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.333277 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7a954be1-eed0-4a0d-a954-de22d372f30d tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.185241 Oct 02 01:01:30.333870 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 330/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:30 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:31.362179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:31.362913 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:31.370532 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.371022 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.371463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.372166 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.372615 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.373155 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.569370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.579381 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.581174 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.582799 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bdb3e715-1e2f-43cd-9bc2-494c2ed0547b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.225479 Oct 02 01:01:31.597251 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 338/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:31 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:32.611034 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.612379 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:32.622036 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.622540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.622980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.623728 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.624188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.624616 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.896378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:32.905283 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:32.906721 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:32.907878 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4f1f2086-92fd-4cb7-b212-3c3f8c78d3a7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.301820 Oct 02 01:01:32.908429 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 331/669] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:32 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:33.935754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:33.937101 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:33.945556 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.946402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.948056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.949197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.950179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.950947 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.186758 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:34.197436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:34.199900 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:34.202262 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-90ced4c2-2474-4510-994f-9868e2a3c192 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.270937 Oct 02 01:01:34.223212 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 339/670] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:33 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:35.215814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.217153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.224523 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.230474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.231863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.235613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.236068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.236810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.239171 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.240849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.241708 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.247281 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.248075 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.248915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.249480 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.249969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.288074 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-34fd31ee-211f-43d7-867f-b21757ce1b1a tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/ips" status: 200 len: 146 microversion: 2.1 time: 0.389756 Oct 02 01:01:35.298258 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 332/671] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:01:34 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/ips => generated 146 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:35.627608 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.660858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.666615 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.669697 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7bef4e46-81e0-4d2f-8681-5d12e9f9c136 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1744 microversion: 2.20 time: 0.442102 Oct 02 01:01:35.671775 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 340/672] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:35 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1744 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:36.265464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f7e65d6f-d46d-4a7f-8beb-ac85e33e9259 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: .version_select at 0x7feb0472c1f0>, body: {"keypair": {"name": "tempest-keypair-1027625240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2frFdFS2M3N2YXL0TfeVlNTgIcKY5lSyMDpuL7T8fpXzJjBCJ75+hYjBP16ExJ6SQ8rhC0sJepGTCQFYVW3CC7Urrhdl0oen5qZx0WEOm26au0paeKD9HCH+j1SumoQ=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:36.299205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f7e65d6f-d46d-4a7f-8beb-ac85e33e9259 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:36.309462 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-f7e65d6f-d46d-4a7f-8beb-ac85e33e9259 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:36.352200 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f7e65d6f-d46d-4a7f-8beb-ac85e33e9259 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177998 Oct 02 01:01:36.353187 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 333/673] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:01:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:36.705006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:36.708802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.726463 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.726968 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.727413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.728756 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.732781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.732781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.889609 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43f9a55d-43a0-408e-9547-a4178dbce03e"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:36.892135 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.899127 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.899695 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.900138 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.900973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.901480 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.901910 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.955186 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.965803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.969585 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.973283 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fb11f300-d775-48de-b0c8-b6215a35373a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1744 microversion: 2.20 time: 0.272793 Oct 02 01:01:36.974375 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 341/674] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:36 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1744 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:37.279279 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f87707f4-5419-4749-bf5a-7edde9f6f039 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392457 Oct 02 01:01:37.280987 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 334/675] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:01:36 2022] POST /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:37.630873 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "name": "network-vif-plugged", "status": "completed", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:37.643346 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.643929 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.644439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.677094 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] Creating event network-vif-plugged:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:01:37.687247 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-8396ddef-0539-42c9-9cb3-1bfa21733030 req-f930ac6d-0536-4aa7-93ca-9fe60417341d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059368 Oct 02 01:01:37.688488 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 342/676] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:38.009380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:38.011165 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:38.024265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.025865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.026999 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.028622 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.029627 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.030751 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.246375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.256066 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.257758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.259865 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e44a4b71-c4e4-4dda-9f09-d6866cad8460 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.259067 Oct 02 01:01:38.260667 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 335/677] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:37 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:38.281389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1880890883", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17d77a0a-6f79-4f56-8106-1a30e4953c88"}], "security_groups": [{"name": "tempest-securitygroup--681169025"}], "key_name": "tempest-keypair-1027625240", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:38.417154 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] validate_networks() for [('17d77a0a-6f79-4f56-8106-1a30e4953c88', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:39.011955 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:39.012649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:39.013152 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:39.013571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:39.014115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:39.023982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.025439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.026446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.027737 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.028433 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.029684 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.047234 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:39.057469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:39.079233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:39.081685 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:39.143238 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2a4da71c-185c-4a4d-ab94-4ef2cce6eea0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.866514 Oct 02 01:01:39.144974 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 343/678] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:39.157169 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2686326b-5ed7-4003-a58c-b63641f05b9e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.158446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2686326b-5ed7-4003-a58c-b63641f05b9e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.254868 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2686326b-5ed7-4003-a58c-b63641f05b9e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.268862 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2686326b-5ed7-4003-a58c-b63641f05b9e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1242 microversion: 2.1 time: 0.116105 Oct 02 01:01:39.271484 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 336/679] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:39.296453 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.298949 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.308563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.309137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.309592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.310369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.310833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.311438 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.562222 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.572498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.574413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.575604 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e4940529-fd85-48ce-8f6e-213b947317eb tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.285838 Oct 02 01:01:39.576451 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 344/680] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:39.715583 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.719541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.748509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.749166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.749633 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.750392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.750860 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.751830 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.806996 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d8933e34-bc9e-48da-8a51-df5a40a79ce6 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098018 Oct 02 01:01:39.808460 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 337/681] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:39.821773 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.822819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.835602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.837749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.838528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.839268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.839738 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.840175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.877011 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2470aef4-1215-4693-b37d-8469c52f0dc3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e" status: 200 len: 194 microversion: 2.1 time: 0.059760 Oct 02 01:01:39.884176 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 345/682] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:40.298189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:40.299577 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:40.341194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.343079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.344798 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.347501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.349526 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.351391 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.507674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.521540 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4b596ea0-125e-442b-ab75-00593aae154f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1238 microversion: 2.1 time: 0.228725 Oct 02 01:01:40.522647 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 338/683] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:40 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1238 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:40.606677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:40.607855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:40.622061 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.622750 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.623287 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.625044 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.625539 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.626069 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.795617 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.810406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.812334 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.813961 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-31c5a506-0e4a-4581-ba31-ee21a73a6671 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.216195 Oct 02 01:01:40.814696 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 346/684] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:40 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:41.516874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb4a9e56-2329-4e5d-a64c-73eaeee1acdc"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:41.519945 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:41.540249 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.541201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.541858 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.542988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.543749 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.544673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.549472 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:41.550422 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:41.560833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.568555 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.569599 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.570702 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.571892 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.572497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.741033 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:41.757416 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-41fc3ea5-a1c8-4836-bbf0-1fabe865ce16 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1300 microversion: 2.1 time: 0.212076 Oct 02 01:01:41.758478 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 347/685] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:41 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:41.842622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:41.843475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:41.855090 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.855613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.856043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.856754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.857286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.857726 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:42.077997 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6475b88d-30a5-420f-a13e-0d999b067cce tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "POST /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566268 Oct 02 01:01:42.079198 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 339/686] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:01:41 2022] POST /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:42.160074 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:42.182669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:42.184992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:42.190583 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ab2931d1-967d-4d44-8552-1118389d28e7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.351846 Oct 02 01:01:42.191828 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 348/687] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:41 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:42.788741 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:42.789528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:42.799112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.799886 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.800489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:42.801627 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.802260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.802852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.101410 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.111787 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ede5adee-1768-4132-857b-72308d67bc3c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.334838 Oct 02 01:01:43.132636 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 340/688] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:42 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:43.250916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:43.252771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:43.263185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.263779 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.264307 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.265285 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.265859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.266359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.518606 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.530764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.532677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.533983 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ebdd1770-81f7-401e-9f5c-bb7b453a16b6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.287456 Oct 02 01:01:43.549177 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 349/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:43 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:43.663171 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522", "tag": "79d2d2fd-4274-4dd1-a4fd-acba928b87c7"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:43.675862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.676351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.676794 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.688676 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:43.691000 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] Creating event network-changed:79d2d2fd-4274-4dd1-a4fd-acba928b87c7 for instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 on hv-cinder-maste Oct 02 01:01:43.696530 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-99dc672f-598f-4dde-ae82-41fd045eb5cd req-32ae2d20-0c2a-476a-a2c1-81ca32fec381 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037122 Oct 02 01:01:43.697812 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 341/690] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:44.142421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.143394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.150885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.151747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.152456 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.153475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.154157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.154802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.361856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.380385 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-94bab9b2-1a56-41fe-afe6-75aff9c0a7fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.242673 Oct 02 01:01:44.393048 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 350/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:44.516146 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.519250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.527080 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.527714 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.528411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.529217 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.529959 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.530683 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.564805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.565817 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.570520 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9937e90e-4eec-41a1-839d-a530753c4c3e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058632 Oct 02 01:01:44.572495 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 342/692] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:44.580045 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.580563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.581805 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.582842 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.583363 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.583804 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.719711 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.720557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.726797 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.728427 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.729253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.730324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.730935 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.731438 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.779378 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-42373cb1-a894-4535-94ce-e752d6b5f979 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e" status: 200 len: 194 microversion: 2.1 time: 0.063541 Oct 02 01:01:44.792374 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 343/693] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:44.797996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.798812 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.806776 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.807585 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.808263 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.809209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.809865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.814336 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.838293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.849598 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.851071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.852410 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d920f0f0-b74c-4514-93ae-dd72d9e806c6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.294138 Oct 02 01:01:44.869500 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 351/694] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:44.949923 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'services' on Instance uuid 54569b08-ca2c-4cda-a7be-92731fac9759 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:45.052169 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-dc1bfe66-19b3-41c9-9d92-5d87aa327e3d tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e" status: 202 len: 0 microversion: 2.1 time: 0.257653 Oct 02 01:01:45.052768 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 344/695] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:01:44 2022] DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/43f9a55d-43a0-408e-9547-a4178dbce03e => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:45.417018 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:45.418148 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:45.424531 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.425054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.425493 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.426379 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.435027 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.435611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.595575 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:45.604808 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3b75c7d8-9b97-4e67-b64d-221f6963a558 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.201747 Oct 02 01:01:45.605874 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 352/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:45 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:45.888140 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:45.889442 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:45.896010 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.896825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.897685 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.898641 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.899276 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.899867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.053172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.062301 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.063888 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.065197 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-dc65fc1d-ff5c-48cf-bcde-f66a0d2d9866 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.182508 Oct 02 01:01:46.065777 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 345/697] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:45 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:46.629549 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:46.631092 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:46.638445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.639316 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.639985 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.640982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.641664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.642314 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.667130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=100 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:46.835442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.844009 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1fbc5c66-df5e-4bae-910f-e69f4b4a70d0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.219810 Oct 02 01:01:46.845228 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 353/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:46 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:47.091626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.092812 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.099758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.100145 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.100591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.101332 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.101792 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.102222 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.271175 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.271849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.282372 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.283005 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.283543 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.284596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.285050 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.285583 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.335140 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0301cc94-92da-456e-8555-1ef2d1906722 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/cb4a9e56-2329-4e5d-a64c-73eaeee1acdc" status: 200 len: 194 microversion: 2.1 time: 0.068361 Oct 02 01:01:47.336339 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 354/699] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 2 01:01:47 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/cb4a9e56-2329-4e5d-a64c-73eaeee1acdc => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:47.355620 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.356297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.363739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.364432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.365008 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.365875 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.366469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.367568 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.568026 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:47.575838 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'services' on Instance uuid 54569b08-ca2c-4cda-a7be-92731fac9759 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:47.579261 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:47.579883 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:47.581143 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-73ba3943-40cf-4d23-ac96-1e29dd0e77bf tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.493496 Oct 02 01:01:47.589020 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 346/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:47 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:47.663603 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a75125d6-2494-486f-8ef0-107154532fe0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/cb4a9e56-2329-4e5d-a64c-73eaeee1acdc" status: 202 len: 0 microversion: 2.1 time: 0.317322 Oct 02 01:01:47.665064 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 355/701] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:01:47 2022] DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments/cb4a9e56-2329-4e5d-a64c-73eaeee1acdc => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:47.871167 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.873432 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.886100 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.886693 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.887306 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.888090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.888602 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.889009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.034925 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.044133 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8b0f4586-5932-453d-aa7b-ff8a4f0afa01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.179676 Oct 02 01:01:48.045517 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 347/702] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:47 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:48.610172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:48.611315 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:48.618752 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.619347 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.619856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.620641 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.621201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.621871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.822649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.847857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.851415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.854102 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f428eb7c-167d-4a34-afd3-6aa85865e54a tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.249429 Oct 02 01:01:48.859788 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 356/703] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:48 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:48.901851 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:48.904261 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:48.911439 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.912186 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.912625 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.913368 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.914013 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.915223 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.948890 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ac081b6f-e6d6-4650-8057-f8e96c7c1054 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051228 Oct 02 01:01:48.955229 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 348/704] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:48 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:49.069237 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.069845 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.077181 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.079620 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.086112 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:49.087162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:49.088184 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.088749 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.089188 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.089325 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.090059 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.090662 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.090804 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.091310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.091755 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.092002 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.092753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.093646 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.131800 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-82f27d9e-6a58-4d2d-93c1-40561e06f3d0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058490 Oct 02 01:01:49.138724 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 349/705] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:49.236425 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.237809 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.244898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.245421 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.246123 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.246841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.247290 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.247882 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.266673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=6 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:49.267105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:49.276251 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a05f511a-ccdd-4bd8-a10d-6dd7c30ff476 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.210763 Oct 02 01:01:49.276845 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 357/706] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:49.278630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:49.438999 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f4d22bac-e978-4401-a990-9afd077cfddf tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 204 len: 0 microversion: 2.1 time: 0.206255 Oct 02 01:01:49.439965 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 350/707] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:49 2022] DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:49.451051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.451860 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.458355 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.458625 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.459415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.461171 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.462347 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.462989 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.585857 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522", "name": "network-vif-plugged", "status": "completed", "tag": "79d2d2fd-4274-4dd1-a4fd-acba928b87c7"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:49.609905 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.611465 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.612100 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.634443 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:49.638311 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] Creating event network-vif-plugged:79d2d2fd-4274-4dd1-a4fd-acba928b87c7 for instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 on hv-cinder-maste Oct 02 01:01:49.645608 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fe816070-3716-416f-a812-952356f57705 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1672 microversion: 2.1 time: 0.200486 Oct 02 01:01:49.647852 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 358/708] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:49.651713 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-21bde1db-829a-4f75-ae0f-7a9598691a3a req-7eb3b82d-9ecd-49d9-b150-621c0d6a20c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070344 Oct 02 01:01:49.652321 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 351/709] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:49.897997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.898610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.906475 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.906974 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.907418 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.908140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.908596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.909051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.053257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.063593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.065562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.067063 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d37633fc-46a6-4513-bed0-fffc96813d82 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.172827 Oct 02 01:01:50.067796 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 359/710] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:50.299612 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:50.300322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:50.306633 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.307123 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.307561 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.308254 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.308715 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.309176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.441088 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.449434 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e7cc18ec-be23-438c-9967-a509a2afc8c8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.154504 Oct 02 01:01:50.450005 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 352/711] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:50 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:50.671779 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:50.672389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:50.674267 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:50.679536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.680094 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.680841 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.681577 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.682033 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.682461 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.815408 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.823956 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e99fd384-41ed-40be-b916-3186ca9981f0 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1672 microversion: 2.1 time: 0.156226 Oct 02 01:01:50.824533 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 360/712] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:50 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:51.094871 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:51.095890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:51.103724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.104385 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.104856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.105738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.106524 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.106994 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.252958 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.262316 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.263752 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.264920 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d5fdc77d-3063-44d5-96f3-46645a5ee300 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1739 microversion: 2.20 time: 0.175224 Oct 02 01:01:51.265496 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 353/713] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:51 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:51.473240 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:51.473868 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:51.480605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.481134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.481580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.482292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.482755 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.483185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.647227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.656391 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-23153229-c39a-4d94-a0fe-f3360a0bb6e4 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.187118 Oct 02 01:01:51.656991 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 361/714] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:51 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:51.850065 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:51.850625 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:51.857966 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.858569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.859134 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.860102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.860775 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.861289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.040866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:52.049160 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-49bb5251-e2a1-4e45-aced-d01a7d81e72e tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1672 microversion: 2.1 time: 0.203375 Oct 02 01:01:52.049855 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 354/715] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:51 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:52.291981 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:52.292704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:52.298914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.299413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.299889 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.300588 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.301076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.301504 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.436006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:52.445403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:52.446865 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:52.448040 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-51589559-c023-4666-8d10-9b8d1d567990 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1721 microversion: 2.20 time: 0.161181 Oct 02 01:01:52.448597 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 362/716] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:52 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:52.679128 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:52.679667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:52.686527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.687029 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.687658 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.688375 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.689041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.689358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.821340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:52.829642 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0a007100-b5fc-4d20-8951-8d75519088f2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1367 microversion: 2.1 time: 0.154295 Oct 02 01:01:52.830120 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 355/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:52 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:53.076380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:53.078003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:53.091300 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.091910 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.092367 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.093153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.093618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.094052 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.099771 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54569b08-ca2c-4cda-a7be-92731fac9759", "name": "network-vif-deleted", "tag": "914a24fd-cc04-42d2-970d-322c736ede19"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:53.112177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.113267 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.114029 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.129613 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] Creating event network-vif-deleted:914a24fd-cc04-42d2-970d-322c736ede19 for instance 54569b08-ca2c-4cda-a7be-92731fac9759 on hv-cinder-maste Oct 02 01:01:53.135692 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-e55398dc-6e16-4ad6-afad-c630e7b0799c req-ac7a72ad-61b5-41a9-864f-f51749cf29e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112220 Oct 02 01:01:53.136481 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 363/718] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:53.172888 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.175126 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:53.183736 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-908638d6-d50c-4632-89a7-7bf543a7adec tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1606 microversion: 2.1 time: 0.112040 Oct 02 01:01:53.184339 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 356/719] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:53 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:53.476268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:53.477793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:53.487610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.493233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.493827 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.495781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.497439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.498147 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.668982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.677366 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.678828 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.680641 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4884c0f9-9862-4798-826f-3a45a5558b42 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1721 microversion: 2.20 time: 0.209311 Oct 02 01:01:53.681243 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 364/720] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:53 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:53.856257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:53.856918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:53.864448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.864874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.865340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.866075 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.866787 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.867214 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.009328 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:54.017898 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-350aaf72-e2b7-49ab-8209-09bd020e77f6 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1556 microversion: 2.1 time: 0.166994 Oct 02 01:01:54.018653 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 357/721] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:53 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:54.041357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:54.041850 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:54.048483 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.048973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.049415 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.050301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.050569 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.050992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.139119 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c86e6b4a-03cd-4017-b6b4-82167b6ab717 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102285 Oct 02 01:01:54.141105 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 365/722] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:01:54 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:54.207825 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:54.208626 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:54.216401 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.216901 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.217396 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.218120 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.218752 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.219189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.261305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.261803 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.262433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.263062 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'fault' on Instance uuid 54569b08-ca2c-4cda-a7be-92731fac9759 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:54.329337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:54.337771 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-7fddf612-218c-4bf1-ab19-5fd3e4e6babc tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1327 microversion: 2.1 time: 0.133767 Oct 02 01:01:54.338355 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 358/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:54 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:54.707223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:54.707966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:54.715565 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.716235 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.716754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.717551 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.718088 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.718512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.994130 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.003280 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.005124 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.006391 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8a7e05aa-60e9-4f74-86b7-bf7858b3a5e6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1721 microversion: 2.20 time: 0.303212 Oct 02 01:01:55.007039 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 366/724] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:54 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:55.362447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:55.365138 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:55.376077 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522", "tag": "79d2d2fd-4274-4dd1-a4fd-acba928b87c7"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:55.380801 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.381735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.382552 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.384440 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.385059 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.385704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.390573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.391221 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.391729 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.405759 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] Creating event network-changed:79d2d2fd-4274-4dd1-a4fd-acba928b87c7 for instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 on hv-cinder-maste Oct 02 01:01:55.415210 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-4b17857f-853f-4e88-a932-004220523083 req-6afb7d74-0c09-4d71-a456-5f9bbea4ec21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113794 Oct 02 01:01:55.419241 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 359/725] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:55.438098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.438592 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.439032 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.439518 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lazy-loading 'fault' on Instance uuid 54569b08-ca2c-4cda-a7be-92731fac9759 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:55.505282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f392d3cac0149b09d4f83e83a930298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3cd95384ef44d58659e77a1cd99e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.521163 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ae15bc2a-540e-40c6-88dd-e61a288fc827 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 200 len: 1327 microversion: 2.1 time: 0.162556 Oct 02 01:01:55.522813 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 367/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:55 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:55.757665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "name": "network-vif-unplugged", "status": "completed", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:55.768376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.768862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.769689 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.782261 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] Creating event network-vif-unplugged:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:01:55.787383 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-07cc4277-edf3-4389-bfe2-5481cb121c4b req-a07c0a51-0dc5-482f-82de-a9cff041cb7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033771 Oct 02 01:01:55.788163 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 360/727] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:56.039571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.040793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.049278 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.049780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.050424 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.051157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.051975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.052615 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.208441 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.217631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.219265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.220665 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4d1d14c0-827e-4534-bd84-c493ad56f322 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1664 microversion: 2.20 time: 0.190951 Oct 02 01:01:56.229509 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 368/728] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:56.249866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38b88005-4fa4-4fb7-9356-228d03be0e3c"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:56.252866 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.260553 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.261392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.262138 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.262740 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.263215 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.263713 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.546656 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.547232 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.553498 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.554002 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.554456 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.555867 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.556416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.556828 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.571151 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 HTTP/1.1 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:01:56.572918 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:56.575202 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '54569b08-ca2c-4cda-a7be-92731fac9759'} Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:56.576374 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:56.578432 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:56.580772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:56.580772 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-303ee552-e6af-4441-910f-93a753ec13c3 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 404 len: 111 microversion: 2.1 time: 0.031749 Oct 02 01:01:56.580772 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 369/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:01:56.581965 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-32717b1c-5d90-4a8d-b266-3af04ee7a759 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336699 Oct 02 01:01:56.583500 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cb71cadf-cd07-4373-97f2-9ae80e1d6263 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '.version_select at 0x7feb04ab9f70>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.585506 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 361/730] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Oct 2 01:01:56 2022] POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:56.615706 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cb71cadf-cd07-4373-97f2-9ae80e1d6263 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935641085" status: 202 len: 0 microversion: 2.1 time: 0.035382 Oct 02 01:01:56.617050 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 370/731] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Oct 2 01:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935641085 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:56.730912 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.731417 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.737548 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.738042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.738480 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.739196 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.739672 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.740081 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.018280 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4dcf7287-3379-4754-b9f1-22e0973931f5 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments/38b88005-4fa4-4fb7-9356-228d03be0e3c" status: 202 len: 0 microversion: 2.20 time: 0.292332 Oct 02 01:01:57.018888 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 362/732] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Oct 2 01:01:56 2022] DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments/38b88005-4fa4-4fb7-9356-228d03be0e3c => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:57.083452 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:57.084152 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:57.091550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.092059 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.092497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.093243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.093702 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.094127 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.129181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120760) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:01:57.156374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:57.212483 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8a63a26f-b982-40f1-ab68-900353445060 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/action" status: 202 len: 0 microversion: 2.20 time: 0.132688 Oct 02 01:01:57.216548 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 371/733] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 2 01:01:57 2022] POST /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:57.222369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:57.223484 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:57.233029 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.233684 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.234189 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.235177 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.236082 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.236590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.403280 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:57.417479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:57.419220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:57.420492 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-922fc108-f7b1-40e5-b3f8-9e4fd86d71ae tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1672 microversion: 2.20 time: 0.202784 Oct 02 01:01:57.436430 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 363/734] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:57 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:58.448206 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.448813 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:58.455344 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.455842 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.456288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.457031 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.457495 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.457926 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.618301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.628382 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.630067 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.631363 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1925a956-0fa8-4fd5-8e67-407dbda219c4 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1674 microversion: 2.20 time: 0.187352 Oct 02 01:01:58.632062 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 372/735] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:59.676492 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.678094 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.686186 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.686927 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.687579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.688665 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.689164 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.689591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.692972 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.693469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.700447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.700975 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.701428 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.702336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.702784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.703210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.720332 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 HTTP/1.1 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:01:59.722574 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.724142 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '54569b08-ca2c-4cda-a7be-92731fac9759'} Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:59.725283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.726523 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.727722 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:59.727722 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4a136a78-203d-4a00-8215-8968db26ff76 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 404 len: 111 microversion: 2.1 time: 0.034903 Oct 02 01:01:59.727722 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 373/736] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:59 2022] DELETE /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:59.733180 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.733562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: 54569b08-ca2c-4cda-a7be-92731fac9759] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.739645 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.740134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.740746 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.741953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.743212 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.743863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.763342 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 HTTP/1.1 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:01:59.764899 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.766296 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '54569b08-ca2c-4cda-a7be-92731fac9759'} Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:59.767032 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. Oct 02 01:01:59.768230 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:01:59.769520 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance 54569b08-ca2c-4cda-a7be-92731fac9759 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:59.769520 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2ebc4120-8f9b-4037-a972-addd9fe2a963 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759" status: 404 len: 111 microversion: 2.1 time: 0.037599 Oct 02 01:01:59.769520 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 374/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/54569b08-ca2c-4cda-a7be-92731fac9759 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:59.854706 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.865191 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.867302 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.868521 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0fb64d52-3104-40bd-b737-a134156cdbce tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.196366 Oct 02 01:01:59.871465 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 364/738] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:00.900150 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:00.900816 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:00.907670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.908162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.908600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.909370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.909824 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.910245 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.973125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:00.974078 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:00.976828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:00.984384 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.984977 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.985414 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.986187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.986652 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.987083 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.009316 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b HTTP/1.1 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:02:01.011922 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.013825 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'b015e40c-98d7-4fec-98e1-ad84b496767b'} Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:01.014821 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.016666 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.018235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:01.022169 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-adacabd7-c111-4d86-b74c-23d84fcd83ed tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 404 len: 111 microversion: 2.1 time: 0.053579 Oct 02 01:02:01.022793 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 365/739] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:00 2022] DELETE /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:02:01.033758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:01.034505 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] [instance: b015e40c-98d7-4fec-98e1-ad84b496767b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:01.042867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.043411 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.043930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.044697 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.045233 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.045663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.063732 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] HTTP exception thrown: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Request method failure captured: Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b HTTP/1.1 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG7usoYv7dwGIrHCbifKgyquSAzBSLwksxyNrZifwq7DPxsCTx4sWWEKtFzOr-TWKgejdXEynM2xXttWbETvHZIaIE13dYjzMfhmQvP1-RM8Q32qTupHxcg806vNVmjF4iVVkgKMtTjxyKv6CJd7A04ZLNhpwu1OccL1fKv8OmMtC4 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:02:01.065331 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef3cd95384ef44d58659e77a1cd99e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: ef3cd95384ef44d58659e77a1cd99e05 Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-233795295 Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 1f392d3cac0149b09d4f83e83a930298 Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeTestJSON-233795295-project Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.066780 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'b015e40c-98d7-4fec-98e1-ad84b496767b'} Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:01.067681 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. Oct 02 01:02:01.069035 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:01.070217 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] Returning 404 to user: Instance b015e40c-98d7-4fec-98e1-ad84b496767b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:01.070217 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4ff30c93-da1b-41a1-b062-82b0a2bbfbb4 tempest-AttachVolumeTestJSON-233795295 tempest-AttachVolumeTestJSON-233795295-project] 10.222.0.26 "GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b" status: 404 len: 111 microversion: 2.1 time: 0.038914 Oct 02 01:02:01.070217 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 366/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:01 2022] GET /compute/v2.1/servers/b015e40c-98d7-4fec-98e1-ad84b496767b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:02:01.135580 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.144819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.146731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.148346 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1b5940de-2bfd-4813-a576-dbce2d0e0702 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.252396 Oct 02 01:02:01.149515 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 375/741] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:00 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:02.181251 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:02.182405 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:02.193674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.194618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.196014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:02.197358 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.198187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.198972 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:02.376393 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:02.392454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:02.394791 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:02.396403 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b37957c8-bbd5-4739-8f42-f1a972d1013f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.224389 Oct 02 01:02:02.397219 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 367/742] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:02 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:03.425838 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:03.427087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:03.436061 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.436576 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.437052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.437789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.438254 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.438688 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.999943 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:04.009250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:04.017082 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:04.019840 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-002953d6-83f6-42ba-88a5-9fcf24fb91a2 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.598061 Oct 02 01:02:04.025061 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 376/743] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:03 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:05.067630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:05.072467 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:05.085845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.086617 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.087429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.088469 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.089190 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.096416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.490636 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:05.503393 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:05.504867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:05.506135 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c0682040-5318-4085-84d1-100abbb21e75 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.456972 Oct 02 01:02:05.506722 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 368/744] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:05 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:02:06.552909 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:06.554979 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:06.565819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.567239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.568603 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.570774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.572087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.573535 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.897290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:06.912898 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:06.930008 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:06.933144 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-429cf165-6fdb-41c8-ae0f-f5fa64080253 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.387919 Oct 02 01:02:06.968705 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 377/745] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:06 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:02:07.978610 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:07.980003 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:07.986933 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:07.987512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:07.988042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:07.988818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:07.989521 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:07.989956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.166099 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:08.186162 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:08.188163 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:08.189624 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d13273e7-0806-4f7e-a553-1712fb888135 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.215424 Oct 02 01:02:08.190417 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 369/746] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:07 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:02:09.222217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:09.222999 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:09.229673 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.230030 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.230444 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.231143 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.231590 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.232197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.376469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:09.387336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:09.389097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:09.390815 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-41b1b2f0-e04a-4986-8b4b-acbb2ac01cd7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.172601 Oct 02 01:02:09.391308 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 378/747] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:09 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:10.423305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:10.423935 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:10.439629 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:10.440067 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:10.441124 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:10.448915 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:10.449736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:10.450381 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:10.494652 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:10.641404 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:10.651523 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:10.653287 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:10.654535 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e462b068-f83c-47b8-b0fe-9dace63b7cd6 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.241395 Oct 02 01:02:10.655174 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 370/748] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:10 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:11.680056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:11.681405 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:11.688724 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.689259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.689747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:11.690446 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.691181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.691572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:11.842356 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:11.850451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:11.852307 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:11.853532 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-047de887-9913-47dd-ba25-bf53a4f290af tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.177787 Oct 02 01:02:11.854097 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 379/749] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:11 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:12.880176 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:12.880760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:12.888369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:12.888867 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:12.889335 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:12.890057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:12.890514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:12.890944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:13.044202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:13.052501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:13.054012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:13.055187 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f2a6437f-b7be-4ea5-8836-662d642a365b tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.179263 Oct 02 01:02:13.055745 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 371/750] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:12 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:13.815162 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "name": "network-vif-plugged", "status": "completed", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:13.825051 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:13.825537 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:13.825973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:13.837825 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] Creating event network-vif-plugged:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:02:13.843238 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-c5b936be-e261-4c9f-a098-bd5991c99bcb req-8df7bc52-8166-4135-aed1-005f5098a2a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162000 Oct 02 01:02:13.843943 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 380/751] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:14.082085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:14.082654 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:14.089469 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:14.089980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:14.090397 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:14.091095 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:14.091550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:14.091982 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:14.228264 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:14.236476 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:14.237952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:14.239112 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3e969b1e-d910-402f-9ff7-1f0b6456812c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.161424 Oct 02 01:02:14.239679 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 372/752] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:14 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:15.267014 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:15.267624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:15.274566 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:15.275054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:15.275488 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:15.276183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:15.276635 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:15.277087 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:15.414406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:15.422884 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:15.424331 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:15.425543 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-634b284e-3d5a-4d39-8216-76c57aa3b70f tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.162982 Oct 02 01:02:15.426102 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 381/753] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:15 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:16.451491 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:16.452209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:16.459325 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.460690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.461260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.462120 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.462591 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.463029 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.627026 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:16.636732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:16.638541 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:16.639746 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-549745b9-b721-40a6-aac8-0faabc9a7fda tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1730 microversion: 2.20 time: 0.192471 Oct 02 01:02:16.640335 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 373/754] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:16 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:17.668479 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:17.669211 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:17.675537 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.676049 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.676490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.677221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.677676 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.678132 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.824403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:17.835720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:17.837268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:17.838457 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a3370382-95f5-43a4-8cd5-48a8b43a89e0 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1717 microversion: 2.20 time: 0.176084 Oct 02 01:02:17.839017 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 382/755] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:17 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:31.537080 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.537598 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:31.539988 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=17 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:31.540648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=20 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:31.547179 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.547673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.548107 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.548818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.549303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.549732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.573664 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-054cbbbf-e036-43b1-8923-022a0f45f851 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/ips" status: 200 len: 148 microversion: 2.1 time: 0.040513 Oct 02 01:02:31.574256 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 374/756] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:32.970305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:32.972876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.975062 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:32.975725 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:32.982337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.982827 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.983263 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.983960 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.984413 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.984902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.283406 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-965f8d88-3750-4f4c-8f87-25ea98fd9423 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315950 Oct 02 01:02:33.284458 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 383/757] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:02:32 2022] POST /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:35.566908 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9518d898-7659-47cf-b89b-3299660d546a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: .version_select at 0x7feb0469b430>, body: {"keypair": {"name": "tempest-keypair-1821419445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGei0uzbGIFL/FjuunnrVj4hGLoVDmSrCVt6AUERzn4zhxTePbGQLi6Mzkg4vxrcwmbXuLV0md4McgMC+XhWscYrmLHqeLOCncMweodNe45iHCey5A1KyRkDsuWVOjHpFA=="}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:35.584762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-9518d898-7659-47cf-b89b-3299660d546a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:35.589043 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-9518d898-7659-47cf-b89b-3299660d546a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:35.613000 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9518d898-7659-47cf-b89b-3299660d546a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049923 Oct 02 01:02:35.613966 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 375/758] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:02:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:36.943378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2058836209", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17d77a0a-6f79-4f56-8106-1a30e4953c88"}], "security_groups": [{"name": "tempest-securitygroup--1969273813"}], "key_name": "tempest-keypair-1821419445", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:37.050794 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] validate_networks() for [('17d77a0a-6f79-4f56-8106-1a30e4953c88', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:37.444069 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:37.444493 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:37.445309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:37.445473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:37.446201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:37.455680 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.456178 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.456626 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.457392 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.457914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.458348 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.475673 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:37.479683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:37.491996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:37.494493 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:37.548792 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-91d18d18-fbda-4876-8128-3b416204a706 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.610043 Oct 02 01:02:37.549690 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 384/759] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:37.562076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-58e92a8a-2ea2-453b-8074-a95e10f24ccd tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:37.563575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-58e92a8a-2ea2-453b-8074-a95e10f24ccd tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:37.635996 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-58e92a8a-2ea2-453b-8074-a95e10f24ccd tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:37.643770 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-58e92a8a-2ea2-453b-8074-a95e10f24ccd tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1242 microversion: 2.1 time: 0.086813 Oct 02 01:02:37.644340 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 376/760] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:37 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:38.666611 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:38.667336 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:38.677294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.677294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.677294 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.678293 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.678913 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.679499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.754536 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:38.764138 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5e62382f-65fa-45fa-9a8f-99072a79adad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1302 microversion: 2.1 time: 0.101830 Oct 02 01:02:38.764770 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 385/761] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:38 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:39.789635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.790253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.798000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.798495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.799096 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.800446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.801159 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.802055 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.949690 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:39.957976 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8cf98a86-cc15-44af-ad4a-5cdbced0e248 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1368 microversion: 2.1 time: 0.172179 Oct 02 01:02:39.958560 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 377/762] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:40.335733 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14da718c-8c95-4157-95c3-93bb32b37381", "tag": "7e613d49-a5fc-4a93-9a48-a18a40b108ad"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:40.349928 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.350486 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.351048 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.363523 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] Creating event network-changed:7e613d49-a5fc-4a93-9a48-a18a40b108ad for instance 14da718c-8c95-4157-95c3-93bb32b37381 on hv-cinder-maste Oct 02 01:02:40.377042 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-d57fd4c6-27cb-4cff-a7b4-ec23841486fb req-e038a614-04d9-432e-b3ac-af5f377d0f47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047099 Oct 02 01:02:40.377768 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 386/763] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:02:40.982831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.983446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.990220 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.990971 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.991413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.992105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.992559 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.993019 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.285939 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:41.293622 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-77603c26-c7ba-46d7-9bf7-f931e7e924b7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1368 microversion: 2.1 time: 0.315249 Oct 02 01:02:41.294246 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 378/764] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:40 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:42.318305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:42.319098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:42.325255 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.326431 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.326964 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.327664 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.328114 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.328534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.477590 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:42.486423 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2466d4e8-56fb-4267-a57c-c677da63720d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1368 microversion: 2.1 time: 0.173052 Oct 02 01:02:42.486661 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 387/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:42 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:43.508890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:43.509526 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:43.516546 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.517060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.517504 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.518231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.518673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.519102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.651627 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:43.660503 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a8e449d5-9377-446b-bbf9-d522d1cf2e7a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1368 microversion: 2.1 time: 0.155393 Oct 02 01:02:43.661174 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 379/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:43 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:43.808993 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14da718c-8c95-4157-95c3-93bb32b37381", "name": "network-vif-plugged", "status": "completed", "tag": "7e613d49-a5fc-4a93-9a48-a18a40b108ad"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:43.820211 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.820715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.821172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.832704 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] Creating event network-vif-plugged:7e613d49-a5fc-4a93-9a48-a18a40b108ad for instance 14da718c-8c95-4157-95c3-93bb32b37381 on hv-cinder-maste Oct 02 01:02:43.837666 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-0bd36932-27b4-4a97-aeb7-e99b60ae774b req-07b4e28a-55a0-4aea-970a-6ea5b5d1005e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032604 Oct 02 01:02:43.838459 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 388/767] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:44.683489 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.685359 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:44.691435 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.691938 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.692403 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.693166 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.693630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.694098 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.830000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:44.837931 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d646901f-88fa-42c4-b070-491f26dc622d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1368 microversion: 2.1 time: 0.158223 Oct 02 01:02:44.848965 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 380/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:45.862017 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:45.862692 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:45.869639 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.870128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.870564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.871359 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.871707 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.872776 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.009343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:46.017690 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a7a11129-f4ae-43b5-89a3-9b538cbf79cc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1558 microversion: 2.1 time: 0.159883 Oct 02 01:02:46.018265 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 389/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:45 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:46.040205 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.040729 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:46.047267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.047762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.048203 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.048908 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.049401 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.049827 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.136535 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3e367b09-e168-4d2f-bd9c-2618af572bef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100198 Oct 02 01:02:46.137185 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 381/770] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:02:46 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:47.479735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14da718c-8c95-4157-95c3-93bb32b37381", "tag": "7e613d49-a5fc-4a93-9a48-a18a40b108ad"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:47.485575 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:47.487474 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:47.492666 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.493183 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.493619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.505368 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] Creating event network-changed:7e613d49-a5fc-4a93-9a48-a18a40b108ad for instance 14da718c-8c95-4157-95c3-93bb32b37381 on hv-cinder-maste Oct 02 01:02:47.510213 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-06ae6b24-c55e-4030-8a84-36b5186b3bc3 req-faf095d8-cc3b-4677-a9c9-c23384e0f4e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Oct 02 01:02:47.510831 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 390/771] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:50.244569 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=6 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:50.248768 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:50.251002 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:50.257183 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.257668 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.258100 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.258789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.259241 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.259664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.289324 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-68dc2e27-d2e4-40f5-a62d-0dd3139b35f1 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045522 Oct 02 01:02:50.304032 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 382/772] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 2 01:02:50 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:50.357882 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:50.358464 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:50.364512 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.365034 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.365733 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.366423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.366870 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.367292 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.392411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:02:50.473101 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-675022e7-97da-45e6-bdba-2448c4c92ec8 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 204 len: 0 microversion: 2.20 time: 0.120339 Oct 02 01:02:50.473709 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 391/773] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:50 2022] DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:02:50.483334 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:50.484539 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:50.492648 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.493175 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.493644 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.494345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.494827 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.495246 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.626956 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:50.635028 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:50.636449 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:50.638219 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e378364e-3976-47dd-a332-d960477028be tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.159022 Oct 02 01:02:50.638886 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 383/774] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:50 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:51.664622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:51.665268 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:51.672145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.672623 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.673086 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.673767 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.674216 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.674634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.810550 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.818631 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.820048 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.821242 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-90b04385-799b-4059-a45e-7aa90a91c293 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1723 microversion: 2.20 time: 0.161004 Oct 02 01:02:51.821800 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 392/775] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:51 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:52.845926 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.846536 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.852965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.853486 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.853928 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.854630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.855092 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.855518 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.920306 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.928886 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.930400 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21c29da391b4d78a063dbe50057b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346545279d0943359a5d495b9dc7f498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.931872 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-aa096fa5-2e57-48e1-a76e-03656e2c1197 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 200 len: 1656 microversion: 2.20 time: 0.089883 Oct 02 01:02:52.932425 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 384/776] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:52 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:02:52.980563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d507f-f4fb-48bc-ac01-74584f97ba88", "name": "network-vif-deleted", "tag": "87884027-8c72-4c1a-8119-24cb2f1ee0f2"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:52.991300 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.991783 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.992215 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.005919 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] Creating event network-vif-deleted:87884027-8c72-4c1a-8119-24cb2f1ee0f2 for instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 on hv-cinder-maste Oct 02 01:02:53.009472 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-f5f78913-c3cf-4eb3-8d38-88e01df8cbf9 req-31ef1714-9822-4c31-8313-c1b50dca86a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Oct 02 01:02:53.010191 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 393/777] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:53.959780 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.960398 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:53.967828 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.968324 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.968771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.969507 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.969976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.970407 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.985891 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 HTTP/1.1 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:02:53.987447 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:53.989300 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'ed0d507f-f4fb-48bc-ac01-74584f97ba88'} Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:53.990086 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:53.991672 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:53.992814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:53.992814 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4148a449-7506-4a5f-b384-7d83643d92ba tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 404 len: 111 microversion: 2.20 time: 0.032952 Oct 02 01:02:53.992814 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 385/778] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:02:53.999409 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9dba37d2-8379-4b92-bb9e-c8a795a265d7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '.version_select at 0x7feb047ea790>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.019039 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9dba37d2-8379-4b92-bb9e-c8a795a265d7 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375427967" status: 204 len: 0 microversion: 2.20 time: 0.024470 Oct 02 01:02:54.019625 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 394/779] 10.222.0.26 () {60 vars in 1262 bytes} [Sun Oct 2 01:02:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375427967 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:02:55.780640 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.781809 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.787823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.788263 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.788700 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.789426 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.789890 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.790315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.803872 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 HTTP/1.1 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:02:55.805453 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.807093 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'ed0d507f-f4fb-48bc-ac01-74584f97ba88'} Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:55.808003 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.810029 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.811506 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:55.811506 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-9a387dca-249a-44e5-998f-8067a287deb9 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 404 len: 111 microversion: 2.20 time: 0.030556 Oct 02 01:02:55.811506 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 386/780] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:55 2022] DELETE /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:02:55.816951 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.817697 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: ed0d507f-f4fb-48bc-ac01-74584f97ba88] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.824345 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.825490 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.825962 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.826652 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.827105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.827529 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.840472 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 HTTP/1.1 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:02:55.842114 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.843736 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'ed0d507f-f4fb-48bc-ac01-74584f97ba88'} Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:55.844636 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. Oct 02 01:02:55.846111 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:55.847411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance ed0d507f-f4fb-48bc-ac01-74584f97ba88 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:55.847411 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e841d8b0-4a1d-48bd-8467-ee85527dda26 tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88" status: 404 len: 111 microversion: 2.20 time: 0.030948 Oct 02 01:02:55.847411 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 395/781] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/ed0d507f-f4fb-48bc-ac01-74584f97ba88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:02:56.991849 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:56.992360 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.998970 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.999457 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.999899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.000594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.001090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.001519 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.015142 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f HTTP/1.1 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:02:57.016695 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.018428 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '0328982f-0ac7-4f28-9aa1-a990a8ddb71f'} Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:57.019349 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.020625 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.022303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:57.022303 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3a8a1a95-c8e5-4f6c-8321-e800a139a7da tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 404 len: 111 microversion: 2.20 time: 0.030502 Oct 02 01:02:57.022303 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 387/782] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:56 2022] DELETE /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:02:57.026571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:57.027181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] [instance: 0328982f-0ac7-4f28-9aa1-a990a8ddb71f] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:57.034082 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.034556 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.034989 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.035668 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.036116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.036534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.050324 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] HTTP exception thrown: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Request method failure captured: Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f HTTP/1.1 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOG6wY8i3a6bEDB9RvDac1QftdhN7j0z-6h9UvA7sZAtQ4VhGCCLm7NAvcMPfQa5IOW3y28kzcOU35tAuM02eud_hsWTDARN980JmdjlnREGjN_8Rbh6v5CLqWbzff89ccnyts1E_db4AqW85UdMJfhcMQ5DAbHwFidHLJiVQ1AlTac Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:02:57.051827 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_346545279d0943359a5d495b9dc7f498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/346545279d0943359a5d495b9dc7f498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/346545279d0943359a5d495b9dc7f498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 346545279d0943359a5d495b9dc7f498 Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558228164 Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: c21c29da391b4d78a063dbe50057b6eb Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558228164-project Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.053551 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '0328982f-0ac7-4f28-9aa1-a990a8ddb71f'} Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:57.054435 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. Oct 02 01:02:57.055895 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:02:57.057227 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] Returning 404 to user: Instance 0328982f-0ac7-4f28-9aa1-a990a8ddb71f could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:57.057227 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-66dc8ad9-deaf-403d-9ab5-77cfb151d22c tempest-AttachVolumeShelveTestJSON-1558228164 tempest-AttachVolumeShelveTestJSON-1558228164-project] 10.222.0.26 "GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f" status: 404 len: 111 microversion: 2.20 time: 0.030481 Oct 02 01:02:57.057227 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 396/783] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 2 01:02:57 2022] GET /compute/v2.1/servers/0328982f-0ac7-4f28-9aa1-a990a8ddb71f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:03:01.594662 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a3bd80ec-e6af-4520-83de-9a67496a4d49 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Action: 'create', calling method: .version_select at 0x7feb04731790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1382409284", "metadata": {"Type": "work"}}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:01.894568 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a3bd80ec-e6af-4520-83de-9a67496a4d49 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.416599 Oct 02 01:03:01.895458 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 388/784] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 2 01:03:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 418 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 01:03:01.909964 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-eb1b07b3-bdaa-4947-a13a-2c7a069235f6 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb048cc040>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:01.964101 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-eb1b07b3-bdaa-4947-a13a-2c7a069235f6 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 200 len: 353 microversion: 2.1 time: 0.057724 Oct 02 01:03:01.964809 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 397/785] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 01:03:01 2022] GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:02.980397 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4026ac5c-c6a1-4806-951e-de2bfc10c0dd tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb04869ee0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.028759 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4026ac5c-c6a1-4806-951e-de2bfc10c0dd tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 200 len: 354 microversion: 2.1 time: 0.052570 Oct 02 01:03:03.029821 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 389/786] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 01:03:02 2022] GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:03.043217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a898e3db-97d0-4683-9d7d-4170cea4943d tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb049d01f0>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.089813 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a898e3db-97d0-4683-9d7d-4170cea4943d tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 200 len: 354 microversion: 2.1 time: 0.050832 Oct 02 01:03:03.090374 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 398/787] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 01:03:03 2022] GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:03.109388 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1e00b682-2e89-45dc-bb15-4f4c976dd597 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb0469b310>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.127320 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:03.127856 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:03.130605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:03.136153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.136671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.137136 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.138039 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.138587 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.139006 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.142052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:03.167684 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lazy-loading 'flavor' on Instance uuid 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:03.177264 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1e00b682-2e89-45dc-bb15-4f4c976dd597 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 202 len: 0 microversion: 2.1 time: 0.072473 Oct 02 01:03:03.177837 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 390/788] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:03:03 2022] DELETE /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:03.185995 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-95ebad7c-6b34-4f36-980d-d8c5be333709 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb04731ee0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.236830 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-95ebad7c-6b34-4f36-980d-d8c5be333709 tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 200 len: 353 microversion: 2.1 time: 0.054853 Oct 02 01:03:03.237435 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 391/789] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 01:03:03 2022] GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:03.248307 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a087cc99-8fc3-4f5a-8ed5-4bcb29bfabdc tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "POST /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84/action" status: 202 len: 0 microversion: 2.1 time: 0.124600 Oct 02 01:03:03.249002 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 399/790] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:03 2022] POST /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:03.256983 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.257733 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:03.259637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:03.266111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.266574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.267019 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.267732 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.268193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.268631 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.285167 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=57 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:03.407612 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:03.416220 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e01309da-0e28-407e-ba4d-4be0bb4be17e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.162998 Oct 02 01:03:03.416782 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 392/791] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:03 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:04.253650 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-61e8bd72-09f1-4a82-9e8a-b63c81f641ff tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Calling method '.version_select at 0x7feb04a213a0>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.281040 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-61e8bd72-09f1-4a82-9e8a-b63c81f641ff tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] HTTP exception thrown: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-61e8bd72-09f1-4a82-9e8a-b63c81f641ff tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Request method failure captured: Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c HTTP/1.1 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOONFe2WRUfe1ERF28fMDbWVhGmDuTd39YdkUTrTWJFPhGYe-nMrP0m85-QKsPfL1dKwtZX_pIQEIA19DIIqyFg8YjwCDZO8dPiC5rKVwednaV_-GnrcGsOUZ20aEZDVkbPvPm_Dm3tLmuftFTEcD31wOqZfIBYRLlMd27TIo8d71iio Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3fbb88cdaae1426581699d654749e149 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-VolumesGetTestJSON-74233704 Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:03:04.283147 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fbb88cdaae1426581699d654749e149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fbb88cdaae1426581699d654749e149"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fbb88cdaae1426581699d654749e149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fbb88cdaae1426581699d654749e149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-VolumesGetTestJSON-74233704 Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3fbb88cdaae1426581699d654749e149 Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-VolumesGetTestJSON-74233704 Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-VolumesGetTestJSON-74233704-project Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 098718ef781845dc8d81900f95dc76a4 Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-VolumesGetTestJSON-74233704-project Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'd1db25e6-5cc0-448f-859e-889f619e078c'} Oct 02 01:03:04.284745 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. (HTTP 404) (Request-ID: req-13d8f3e5-b560-49b3-a2ea-69ff9791c832) Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:04.285802 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:03:04.287195 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 01:03:04.288644 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-61e8bd72-09f1-4a82-9e8a-b63c81f641ff tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] Returning 404 to user: Volume d1db25e6-5cc0-448f-859e-889f619e078c could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-61e8bd72-09f1-4a82-9e8a-b63c81f641ff tempest-VolumesGetTestJSON-74233704 tempest-VolumesGetTestJSON-74233704-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c" status: 404 len: 109 microversion: 2.1 time: 0.035709 Oct 02 01:03:04.290052 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 400/792] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/os-volumes/d1db25e6-5cc0-448f-859e-889f619e078c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:04.441492 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.442228 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:04.448899 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.449436 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.449884 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.450651 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.451216 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.451640 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.587978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:04.596294 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-673be8ad-3a73-4386-ad6d-3993ab89c28e tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.159002 Oct 02 01:03:04.596865 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 393/793] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.622706 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.624388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.631091 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.631751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.632200 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.632923 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.633457 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.633912 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.772724 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.782050 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0c408254-4066-441d-9e1e-7e15b5b0cde6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.165219 Oct 02 01:03:05.782759 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 401/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:06.805954 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:06.806566 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:06.814224 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:06.814718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:06.815154 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:06.815856 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:06.816312 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:06.816747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:06.957687 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:06.965415 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-e595edae-aa5f-4351-bf43-3df627db6a74 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.163340 Oct 02 01:03:06.965988 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 394/795] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:06 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.989250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.989992 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.998317 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.998896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.999416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.000250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.000787 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.001310 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.144368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:08.153490 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-216e5656-a8cf-493b-915a-865574c50064 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.168154 Oct 02 01:03:08.154175 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 402/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:09.177835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:09.179048 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:09.186116 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.186604 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.187035 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.187862 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.188322 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.188745 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.345974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:09.354336 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-8326af20-5ccf-46e3-8344-45f5fbcaf0b7 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.180536 Oct 02 01:03:09.354940 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 395/797] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:09 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:10.379093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:10.379843 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:10.386393 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.386895 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.387484 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.388394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.388858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.389460 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.534376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:10.542953 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-56f65917-f7c0-40d5-840a-1da37c765bdb tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.167745 Oct 02 01:03:10.544880 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 403/798] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:10 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:11.567701 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:11.568342 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:11.575004 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.575596 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.576037 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.576742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.577231 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.577653 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.730136 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:11.738936 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b145fd12-8ca9-4592-a344-eb3064189150 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.175202 Oct 02 01:03:11.739511 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 396/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:11 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:12.764325 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:12.765043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:12.771888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.772439 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.772994 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.773809 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.774309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.774762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.923320 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:12.931595 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-031ac351-4020-444d-a295-9cdd1b6c3601 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.171781 Oct 02 01:03:12.932419 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 404/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:12 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.953885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:13.954558 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.961074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.961557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.961986 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.962699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.963149 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.963579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.105550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:14.114137 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3402cdc2-337a-4e7a-8f12-b6bfd9cc4fba tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.164081 Oct 02 01:03:14.114717 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 397/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:13 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:15.139262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:15.139811 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:15.146277 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.146773 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.147210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.147905 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.148368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.148823 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.286360 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:15.295324 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a31d59f2-ac9c-4956-8a8e-fb19bb680c46 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.160617 Oct 02 01:03:15.295906 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 405/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:15 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:16.319568 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:16.320102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:16.328086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.328575 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.329042 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:16.329739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.330193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.330615 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:16.474027 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:16.483680 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ef5b9a3b-9a35-4c6f-9fb0-da020d97b432 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.168068 Oct 02 01:03:16.484256 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 398/803] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:16 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:17.506873 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:17.507528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:17.515058 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.515554 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.515998 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.516696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.517179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.517604 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.675792 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:17.684466 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-0bbcdd4f-38d6-4359-a369-7a8beb7a8afd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.181241 Oct 02 01:03:17.685249 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 406/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:17 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:18.710784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:18.711340 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.717818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.718315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.718756 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.719460 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.719917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.720344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.860738 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:18.869372 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-67c7592d-edfd-4176-a8c8-2d9b654544ee tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.163335 Oct 02 01:03:18.870064 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 399/805] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:18 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:19.898982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:19.899662 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:19.906863 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.907342 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.907776 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.908654 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.909134 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.909554 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:20.085865 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:20.100072 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c28109c2-66d2-4049-a477-1a29c66c8e1f tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.206751 Oct 02 01:03:20.100629 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 407/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:19 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:21.124551 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:21.125331 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:21.131880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.132321 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.132746 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.133533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.133989 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.134413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.273793 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:21.283747 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-36c35811-68c6-4e7e-a5f9-90384a13b9c1 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1569 microversion: 2.1 time: 0.163837 Oct 02 01:03:21.284770 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 400/807] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:21 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:21.308786 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:21.309460 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:21.316169 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.316657 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.317182 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.317897 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.318545 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.319137 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.350729 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120760) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:03:21.423957 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-cd948272-acef-4ef5-aad1-05b43f481041 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "POST /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84/action" status: 202 len: 0 microversion: 2.1 time: 0.119255 Oct 02 01:03:21.424822 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 408/808] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:21 2022] POST /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:21.433618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:21.434702 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:21.441304 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.441810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.442430 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.443158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.443795 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.444390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.657429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:21.672435 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-86214de6-cca7-412f-ae64-409ba52c92e5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1517 microversion: 2.1 time: 0.243099 Oct 02 01:03:21.673640 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 401/809] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:21 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:22.697709 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:22.698378 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:22.706469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.707039 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.707739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.708562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.709054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.709487 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.863122 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:22.874551 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c05505ac-2334-4dc4-ba5a-1ae0633d0fd2 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1575 microversion: 2.1 time: 0.181190 Oct 02 01:03:22.875614 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 409/810] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:22 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:23.803012 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:23.803620 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.810573 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.811070 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.811509 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.812235 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.812692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.813153 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.836055 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f13e80ea-b2a9-41b5-8797-c8e45b99b4fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/ips" status: 200 len: 150 microversion: 2.1 time: 0.036885 Oct 02 01:03:23.836664 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 402/811] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:03:23 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:23.849116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:23.851532 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.859416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.859906 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.860337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.861288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.861902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.862560 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.910815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:23.911720 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.922144 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.922969 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.923708 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.924903 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.925608 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.926320 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.982762 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: POST /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/os-volume_attachments HTTP/1.1 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 74 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:03:23.985301 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: {"volumeAttachment": {"volumeId": "ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5"}} Oct 02 01:03:23.987049 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'server_id': '14da718c-8c95-4157-95c3-93bb32b37381', 'body': {'volumeAttachment': {'volumeId': 'ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5'}}} Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:23.987859 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:23.989172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:23.990754 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:23.990754 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:23.990754 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:23.990754 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 Oct 02 01:03:23.990754 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:23.992996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 400 to user: Invalid volume: volume ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 is already attached to instances: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:23.994074 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8ccdb56e-3316-4788-a9d4-f86e71205c68 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149220 Oct 02 01:03:23.998210 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 410/812] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:03:23 2022] POST /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:03:24.003115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "name": "network-vif-unplugged", "status": "completed", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:24.015730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.016223 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.016669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.028036 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] Creating event network-vif-unplugged:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:03:24.033689 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-355f30e6-808b-486f-ae0d-3cfa538e4eb7 req-5c9e1bdb-eeb1-44a3-9a62-6b21cf33912a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034205 Oct 02 01:03:24.034348 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 411/813] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:24.039321 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.039966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:24.047233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.047747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.048221 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.049165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.049628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.050563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.077803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:24.092887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:24.100709 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c25287e3-efcc-4d5d-bd5d-e86ff6547ca5 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1575 microversion: 2.1 time: 0.199329 Oct 02 01:03:24.101305 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 403/814] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:23 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:24.131025 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:24.160157 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ebbdc84f-d1f2-41cd-b201-a88c8969835c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 204 len: 0 microversion: 2.1 time: 0.124528 Oct 02 01:03:24.160749 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 412/815] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:24 2022] DELETE /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:24.170090 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.170709 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:24.176703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.177229 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.177671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.178363 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.178823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.179253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.313528 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:24.321207 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5ca16d1c-64cb-4536-be21-8d298b05b9fa tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1683 microversion: 2.1 time: 0.155917 Oct 02 01:03:24.321766 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 404/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:24 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:25.126726 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:25.127916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:25.135362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.135850 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.136283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.137093 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.137619 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.138063 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.280081 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:25.288636 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-45e07fa4-13d6-44fc-b932-11089b0330a6 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1575 microversion: 2.1 time: 0.166535 Oct 02 01:03:25.289485 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 413/817] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:25 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:25.346018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:25.346734 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:25.353257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.353750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.354192 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.354974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.355947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.356382 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.513561 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:25.521585 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-33560721-18b0-460e-aa59-469e04641bbb tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1683 microversion: 2.1 time: 0.179427 Oct 02 01:03:25.522141 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 405/818] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:25 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:26.313976 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.314589 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.321197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.321876 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.322173 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.322896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.323288 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.323707 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.467785 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:26.476399 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a6268732-98fb-4b45-99a5-a1d2ee42059d tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1575 microversion: 2.1 time: 0.166411 Oct 02 01:03:26.477905 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 414/819] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:26 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:26.546633 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.547513 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.554624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.555344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.555790 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.556495 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.556975 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.557410 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.711255 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:26.728174 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6ae2ef56-233c-431b-af25-659d3561c764 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1683 microversion: 2.1 time: 0.186526 Oct 02 01:03:26.728857 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 406/820] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:26 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:27.500140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:27.500867 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:27.507449 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.507931 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.508368 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.509089 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.509542 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.509961 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.681494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14da718c-8c95-4157-95c3-93bb32b37381", "name": "network-vif-deleted", "tag": "7e613d49-a5fc-4a93-9a48-a18a40b108ad"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:27.696723 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.697579 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.698241 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.698822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:27.709215 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5d44224a-5706-47e0-a048-3701145419c8 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1562 microversion: 2.1 time: 0.213396 Oct 02 01:03:27.710040 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 415/821] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:27 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1562 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:27.732472 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] Creating event network-vif-deleted:7e613d49-a5fc-4a93-9a48-a18a40b108ad for instance 14da718c-8c95-4157-95c3-93bb32b37381 on hv-cinder-maste Oct 02 01:03:27.739083 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-a6240624-74fb-452d-86ce-eaa92e0a8fa0 req-7b5d18cc-43b3-4c62-a180-08fedd54ac01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065483 Oct 02 01:03:27.740684 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 407/822] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:27.757656 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:27.758274 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:27.765925 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.766423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.767189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.768313 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.769015 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.769902 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.867088 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:27.882405 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3c8dc4a0-52c1-4726-886a-4b665792628c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 200 len: 1327 microversion: 2.1 time: 0.130828 Oct 02 01:03:27.883308 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 416/823] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:27 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:28.219434 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "name": "network-vif-plugged", "status": "completed", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:28.229032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.229521 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.229960 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.242394 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] Creating event network-vif-plugged:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:03:28.248096 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-3fac16c5-afa9-4aa3-b72c-5f8a720f40e0 req-07aef0a5-e55e-4060-b6fb-ce91ed188ee4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Oct 02 01:03:28.248846 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 408/824] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:28.907965 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:28.908735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:28.916138 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.916871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.918071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.919145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.919745 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.920713 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.936601 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 HTTP/1.1 Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:03:28.938279 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:03:28.939897 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '14da718c-8c95-4157-95c3-93bb32b37381'} Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:28.940710 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:03:28.941998 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:28.943111 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:28.943111 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e763f6f3-c261-48cb-b656-a10757abb614 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 404 len: 111 microversion: 2.1 time: 0.035642 Oct 02 01:03:28.943111 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 417/825] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:28 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:28.950550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a0021f94-35f1-404e-9c8a-1c57228555ba tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '.version_select at 0x7feb046ab310>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:28.971040 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a0021f94-35f1-404e-9c8a-1c57228555ba tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821419445" status: 202 len: 0 microversion: 2.1 time: 0.025638 Oct 02 01:03:28.971543 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 409/826] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821419445 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:29.944397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:29.944925 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:29.951634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.952112 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.952549 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.953262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.953720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.954139 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.037339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lazy-loading 'services' on Instance uuid d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:30.117003 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ec2910bb-6467-47b3-84dc-b124c0659e2e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments/ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5" status: 202 len: 0 microversion: 2.1 time: 0.176376 Oct 02 01:03:30.117624 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 418/827] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:03:29 2022] DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments/ef3fbd3a-8edb-4aff-a5d8-0dfe62fc09e5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:30.126524 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:30.128854 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:30.137822 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.138412 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.138976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.139776 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.140234 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.140663 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.176214 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-19ad9a11-4128-4461-abcd-44a995140e88 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053847 Oct 02 01:03:30.176839 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 410/828] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:03:30 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:31.189119 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.191421 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.197622 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.198114 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.198553 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.199847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.200306 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.200734 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.232288 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7060b97f-b447-4d25-bdf8-b3e4b019afa0 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048023 Oct 02 01:03:31.232871 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 419/829] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:03:31.298448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.299041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.305429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.305924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.306369 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.307071 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.307533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.307965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.330482 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=100 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:31.343599 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:31.423199 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3c257ad3-f5e8-4c6e-a0f8-ed17dd66ce98 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 204 len: 0 microversion: 2.1 time: 0.128339 Oct 02 01:03:31.423789 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 411/830] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:31 2022] DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:31.433163 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.434584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.440735 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.441189 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.441624 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.442318 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.442769 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.443188 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.579267 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.587054 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-202aa7c6-c288-44cd-aa22-da4b954daf83 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1680 microversion: 2.1 time: 0.158082 Oct 02 01:03:31.587613 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 420/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.612816 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.614167 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.621141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.621632 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.622101 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.623676 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.624204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.624637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.763618 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.773279 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6d038c4e-a986-4994-b4f1-88e87ee0e1a7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1680 microversion: 2.1 time: 0.164944 Oct 02 01:03:32.773858 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 412/832] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:33.796317 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:33.797677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:33.803696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:33.806073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.806571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.807012 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.807723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.808179 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.808614 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.958110 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.966597 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-aabfab84-2e3e-41e4-9e9f-3f9af3ba274e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 200 len: 1680 microversion: 2.1 time: 0.174612 Oct 02 01:03:33.971086 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 421/833] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:33 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:34.257544 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522", "name": "network-vif-deleted", "tag": "79d2d2fd-4274-4dd1-a4fd-acba928b87c7"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:34.271172 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:34.277978 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.278472 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.278944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.297059 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] Creating event network-vif-deleted:79d2d2fd-4274-4dd1-a4fd-acba928b87c7 for instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 on hv-cinder-maste Oct 02 01:03:34.304644 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-40d8ae01-3f63-4eb2-8e70-199e888622aa req-115d7b93-b0e0-4569-a241-b4a2312ead38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050696 Oct 02 01:03:34.305943 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 413/834] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:34.995056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:34.996563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.003311 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.003801 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.004242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.004953 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.005430 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.005855 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.022277 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 HTTP/1.1 Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:03:35.023922 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:03:35.025482 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'd2055e3b-ffcc-4bcd-bbcb-ac45c5d18522'} Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:35.026296 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:03:35.027650 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.030340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:35.030340 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-4d2b22c4-e1e4-4524-a295-774f3b3c2544 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 404 len: 111 microversion: 2.1 time: 0.034860 Oct 02 01:03:35.030340 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 422/835] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:34 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:35.039717 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-5f7d6ea3-472b-4f3d-9540-1df81665db5f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '.version_select at 0x7feb04813b80>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.059971 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-5f7d6ea3-472b-4f3d-9540-1df81665db5f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027625240" status: 202 len: 0 microversion: 2.1 time: 0.028423 Oct 02 01:03:35.060561 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 414/836] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:03:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027625240 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:35.740613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5cd3fe80-3def-480b-a844-fe8352a1b28d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: .version_select at 0x7feb0484a1f0>, body: {"keypair": {"name": "tempest-keypair-1137360459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7KU9o3Z+TowiqJmYObZspyV72IIQ/hsnBl0QMfOsomK/9q2K+UhL8JpgsFd/H1q5sYpQNXTj6EwjQLfVbXhTcJvm6XfQrmLf+TRMIH7oi/g4uwyRmNmCwq2AxgsfxV8Q=="}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:35.757270 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5cd3fe80-3def-480b-a844-fe8352a1b28d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:35.761109 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5cd3fe80-3def-480b-a844-fe8352a1b28d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:35.782326 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5cd3fe80-3def-480b-a844-fe8352a1b28d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045796 Oct 02 01:03:35.782923 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 423/837] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:03:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:37.097947 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-403432582", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17d77a0a-6f79-4f56-8106-1a30e4953c88"}], "security_groups": [{"name": "tempest-securitygroup--1790725321"}], "key_name": "tempest-keypair-1137360459", "user_data": "}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.205298 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] validate_networks() for [('17d77a0a-6f79-4f56-8106-1a30e4953c88', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:37.689069 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:37.689516 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:37.690000 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:37.690446 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:37.690896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:37.699671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.700157 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.700600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.701376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.701841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.702276 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.719771 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:37.723784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:37.735704 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:37.738236 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:37.788451 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bbc7c961-7ba1-43e9-97d1-4c16b1a91c7b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.695075 Oct 02 01:03:37.789215 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 415/838] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:37.800888 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2c509ae7-4f61-4fce-9d86-ff4c36f04e22 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.801696 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2c509ae7-4f61-4fce-9d86-ff4c36f04e22 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.857731 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2c509ae7-4f61-4fce-9d86-ff4c36f04e22 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.868586 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2c509ae7-4f61-4fce-9d86-ff4c36f04e22 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1241 microversion: 2.1 time: 0.071741 Oct 02 01:03:37.876963 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 424/839] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:38.897552 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.898682 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.907540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.908044 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.908494 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.909239 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.909703 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.910138 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.973459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:38.982496 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-4d778520-e40b-4485-ad19-4ea54ccf1680 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1293 microversion: 2.1 time: 0.093237 Oct 02 01:03:38.983111 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 416/840] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:38 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:40.006642 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.007389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.014789 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.015362 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.015896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.016668 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.017242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.017754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.169697 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.177729 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-734e7177-236e-48a7-a60b-3a46add0bd42 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1367 microversion: 2.1 time: 0.174824 Oct 02 01:03:40.178306 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 425/841] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:40 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:40.599370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbd4bd7-3924-4adc-98f4-a83f5372676b", "tag": "f1b396b3-dae6-4ec4-88c3-b403411dffe2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:40.610716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.611832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.612275 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.624444 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] Creating event network-changed:f1b396b3-dae6-4ec4-88c3-b403411dffe2 for instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b on hv-cinder-maste Oct 02 01:03:40.629430 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-4c1e047f-3bfd-440e-aedf-414e13da9b2a req-c60b6657-e31e-4070-8a82-2ad1cfa822c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Oct 02 01:03:40.630204 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 417/842] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:41.201266 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.201859 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.208201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.208686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.209157 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.209852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.210300 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.210720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.344465 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:41.352087 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-da0f2b6f-2242-412b-b1f6-d4ce6f8ac18e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1367 microversion: 2.1 time: 0.155256 Oct 02 01:03:41.352649 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 426/843] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:42.379197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:42.380065 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:42.386280 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.386784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.387233 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.387980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.388515 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.388865 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.539629 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.548467 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-93826351-9bd6-48bf-bdad-b46df2f1ec39 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1367 microversion: 2.1 time: 0.174038 Oct 02 01:03:42.549076 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 418/844] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:42 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.572649 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.573704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.580956 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.581467 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.581910 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.582613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.583071 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.583516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.952643 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:43.960469 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fb4a7d4a-695c-4807-814c-0bdb1929be2b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1367 microversion: 2.1 time: 0.393184 Oct 02 01:03:43.961146 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 427/845] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:44.100766 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbd4bd7-3924-4adc-98f4-a83f5372676b", "name": "network-vif-plugged", "status": "completed", "tag": "f1b396b3-dae6-4ec4-88c3-b403411dffe2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:44.111512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.112724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.113194 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.128258 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] Creating event network-vif-plugged:f1b396b3-dae6-4ec4-88c3-b403411dffe2 for instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b on hv-cinder-maste Oct 02 01:03:44.133491 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-bc561045-37aa-4010-9609-edac0f463fa6 req-9498554e-e3fd-4556-b6d8-6beb12ebc6ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036624 Oct 02 01:03:44.134087 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 419/846] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:44.984798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:44.985445 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:44.992142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.992625 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.993094 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.993784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.994239 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.994847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:45.125492 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:45.132983 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6a0ae843-e077-4f39-8297-99ddbf30c866 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1367 microversion: 2.1 time: 0.153181 Oct 02 01:03:45.133549 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 428/847] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:44 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:46.155920 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:46.156674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:46.163385 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.163870 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.164307 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.165023 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.165481 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.165907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.304164 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:46.312853 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ab8abdbd-a473-465c-9a55-b49b13f2e10d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1557 microversion: 2.1 time: 0.161381 Oct 02 01:03:46.313457 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 420/848] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:46 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:46.335170 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:46.335715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:46.342259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.342806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.343246 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.343939 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.344390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.344815 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.427165 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e36fa96d-ef5b-4f43-a3b0-7c0bca0c8a24 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095839 Oct 02 01:03:46.427789 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 429/849] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:03:46 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:47.627143 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbd4bd7-3924-4adc-98f4-a83f5372676b", "tag": "f1b396b3-dae6-4ec4-88c3-b403411dffe2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:47.637370 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.637861 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.638295 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.649327 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] Creating event network-changed:f1b396b3-dae6-4ec4-88c3-b403411dffe2 for instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b on hv-cinder-maste Oct 02 01:03:47.654585 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-a8204984-184d-42d5-bfbd-3e6bf6687323 req-fa08e1b7-d8e8-4485-99b0-8e5c64cb4311 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031310 Oct 02 01:03:47.655241 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 421/850] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:04:08.074762 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.075676 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.076305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=83 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.080753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-ed164026-4b80-433e-a8ca-e003ba45a1ba tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'create', calling method: .version_select at 0x7feb048cc310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-654210781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoNEl4PIFmi+zpudtEb1qcsM6JT6SeK859kRcRuZmonLY+6Gc+Z6W4DhAmOO4JTnJglFxBihWyHCNKhZTt54TONNkhaXyfndnYOuhczIUacEMd7CfD7O3sIZo/oGIG+SA=="}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:08.099534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-ed164026-4b80-433e-a8ca-e003ba45a1ba tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Getting quotas for project 76adee9ec65f48b0b6e582800bc46a62. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:08.103257 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-ed164026-4b80-433e-a8ca-e003ba45a1ba tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Getting quotas for user ba7722296ce14931bc49d3c2912e56f0 and project 76adee9ec65f48b0b6e582800bc46a62. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:08.125127 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-ed164026-4b80-433e-a8ca-e003ba45a1ba tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052215 Oct 02 01:04:08.125725 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 430/851] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:04:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:08.205265 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-913414924", "imageRef": "17ea3cb1-0211-469b-b4da-50317403e10c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-654210781", "networks": [{"uuid": "0f58cd91-f0ba-4533-9ba5-15320caaceee"}]}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:08.213796 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.215138 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=6 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.216057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.217060 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:08.267209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.network.neutron [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] validate_networks() for [('0f58cd91-f0ba-4533-9ba5-15320caaceee', None, None, None, None, None)] {{(pid=120759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:08.642874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Flavor limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:08.643346 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Image limits 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:08.643824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Flavor pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:08.644239 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Image pref 0:0:0 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:08.644655 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.virt.hardware [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:08.653697 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.654187 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.654629 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.655359 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.655820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.656250 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.673880 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Getting quotas for project 76adee9ec65f48b0b6e582800bc46a62. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:08.677889 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.quota [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Getting quotas for user ba7722296ce14931bc49d3c2912e56f0 and project 76adee9ec65f48b0b6e582800bc46a62. Resources: {'instances', 'ram', 'cores'} {{(pid=120759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:08.689844 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Going to run 1 instances... {{(pid=120759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:08.692212 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17ea3cb1-0211-469b-b4da-50317403e10c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:08.738300 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-371b5f94-b68f-4eb4-b753-71bfc7fd43e8 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537216 Oct 02 01:04:08.739315 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 422/852] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:04:08.750440 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-07037770-3241-4dbf-9dcd-97a8040a35bd tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:08.751055 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-07037770-3241-4dbf-9dcd-97a8040a35bd tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:08.805744 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-07037770-3241-4dbf-9dcd-97a8040a35bd tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.812835 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-07037770-3241-4dbf-9dcd-97a8040a35bd tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1257 microversion: 2.1 time: 0.066103 Oct 02 01:04:08.813443 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 431/853] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:08 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:09.837660 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.838286 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.846037 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.846699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.847149 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.847852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.848310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.848739 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.924173 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.932576 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ef76ea4c-584a-4cd3-b58c-37842ef0db8e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1309 microversion: 2.1 time: 0.099855 Oct 02 01:04:09.933293 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 423/854] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:10.964675 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:10.966296 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:10.975918 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.976704 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.977412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.978286 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.978916 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.980042 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.147303 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.159185 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5f7be7b1-6463-45ea-925a-29e6f831e4d3 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.206839 Oct 02 01:04:11.160452 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 432/855] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:10 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:12.183328 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:12.184674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:12.192915 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:12.193450 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:12.193897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:12.194747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:12.195074 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:12.195508 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:12.344906 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:12.353530 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b9549556-cf36-476f-ad74-f456d32f6aaf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.174262 Oct 02 01:04:12.354103 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 424/856] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:12 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:13.377945 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:13.378671 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:13.386315 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.387128 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.387613 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.388329 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.388812 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.389271 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.541201 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:13.549261 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-84eb64c5-68ae-4354-a1c3-e9c9909d9b45 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.175094 Oct 02 01:04:13.561411 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 433/857] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:13 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:14.574798 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:14.575416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:14.581885 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.582380 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.582814 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.583512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.583962 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.584383 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.726260 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:14.735155 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-79996de1-9500-4464-9965-aeeeeb62b397 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.164917 Oct 02 01:04:14.735930 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 425/858] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:14 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:15.759516 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:15.760060 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:15.767597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.768084 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.768730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.769462 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.769921 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.770337 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.913447 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.921887 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a61f58a2-d62e-485c-9d4b-00bbe0078652 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.166726 Oct 02 01:04:15.922669 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 434/859] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:15 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:16.945467 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.946084 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.953942 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.954466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.954960 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.955673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.956144 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.956576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.116762 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:17.125474 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-fc9bf555-97ac-4f29-a1b5-159d37f8f0c9 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.183783 Oct 02 01:04:17.126058 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 426/860] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:18.149790 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.150375 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:18.156787 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.157289 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.157723 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.158412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.158868 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.159290 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.285177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:18.293406 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-86abd160-777b-48ab-beb4-9ce3a6fcf8e2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.147482 Oct 02 01:04:18.293972 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 435/861] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:18 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:19.089142 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:19.096501 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:19.097202 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=6 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:19.102351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.102831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.103262 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.116696 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] Creating event network-changed:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:04:19.122256 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-aa2eb9a8-8cdf-4391-be22-9bed5fbcca5e req-48d40d34-2587-47fc-9c6c-320a2dde1a9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037469 Oct 02 01:04:19.123649 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 427/862] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:19.317606 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.318258 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.320023 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=6 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:19.326946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.327449 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.327891 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.328597 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.329085 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.329519 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.463388 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.471009 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-50b5e85d-1a74-48e9-a420-a7579593cf8b tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.157231 Oct 02 01:04:19.471585 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 436/863] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:20.494875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:20.495577 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:20.502342 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.502859 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.503299 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.503994 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.504452 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.504891 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.638129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.645843 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-34cf7c3c-d69f-4225-8779-ab8c77f08b5c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.155344 Oct 02 01:04:20.646399 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 428/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:20 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:21.669612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:21.670153 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:21.676560 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.677081 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.677521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.678210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.678665 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.679089 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.813283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:21.821120 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-beb5dc08-56b8-4159-9d68-a6840e4c2d58 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.156228 Oct 02 01:04:21.821702 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 437/865] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:21 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:22.845351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:22.845896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:22.852355 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.852844 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.853349 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.856320 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.856794 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.857258 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.987581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:22.996142 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c24356f1-de4e-4b75-8a9b-b8181f841731 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.155072 Oct 02 01:04:22.996708 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 429/866] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:22 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:23.658373 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:23.658943 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:23.665147 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.665677 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.666056 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.666736 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.667181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.667600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.691650 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-124bc462-9a24-4165-9c13-50b715803982 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037133 Oct 02 01:04:23.692214 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 438/867] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:04:23 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:24.019188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:24.019831 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:24.026337 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.026822 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.027815 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:24.028512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.028987 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.029416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:24.178917 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:24.189648 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f02a53bb-123d-4e8f-9b25-c40c16e4cd03 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.174032 Oct 02 01:04:24.190287 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 430/868] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:24 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:25.030682 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6def437-c3df-4e48-aaa4-dcf04a827012"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:25.033330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:25.043168 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.043946 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.044669 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.045844 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.046572 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.047275 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.211850 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:25.212458 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:25.220898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.221667 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.222111 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.222832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.223335 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.223774 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.350105 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-88943eea-0c4a-4492-aceb-024ab7af0735 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324076 Oct 02 01:04:25.356242 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 439/869] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:25 2022] POST /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:25.376691 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.389761 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c4226612-9ba1-494b-8110-ad8732c95791 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.181528 Oct 02 01:04:25.390611 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 431/870] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:25 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:26.231203 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "name": "network-vif-plugged", "status": "completed", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:26.242543 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.243035 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.243469 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.255939 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] Creating event network-vif-plugged:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:04:26.261271 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-0671fb77-3369-4c02-848a-8a7903fd83ba req-dbaedbbd-f047-422f-8378-837b7a72a2f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035418 Oct 02 01:04:26.261926 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 440/871] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:04:26.414659 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:26.415291 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:26.423200 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.423705 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.424156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.424886 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.425390 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.425826 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.634664 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:26.657254 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ed3bcc58-c90a-41e2-930f-47f9b892cf7d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.246247 Oct 02 01:04:26.675723 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 432/872] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:26 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:27.671115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6def437-c3df-4e48-aaa4-dcf04a827012"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:27.673489 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:27.680098 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.680596 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.681073 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.681786 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.682242 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.682670 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.685898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:27.686514 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:27.693068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.693937 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.694065 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.694680 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.695246 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.695592 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.776876 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: POST /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments HTTP/1.1 Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 74 Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:04:27.779206 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: {"volumeAttachment": {"volumeId": "f6def437-c3df-4e48-aaa4-dcf04a827012"}} Oct 02 01:04:27.781452 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'server_id': '6dbd4bd7-3924-4adc-98f4-a83f5372676b', 'body': {'volumeAttachment': {'volumeId': 'f6def437-c3df-4e48-aaa4-dcf04a827012'}}} Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:27.782449 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:27.783842 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 400 to user: Invalid volume: volume f6def437-c3df-4e48-aaa4-dcf04a827012 is already attached to instances: 6dbd4bd7-3924-4adc-98f4-a83f5372676b {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5c55bd78-b68c-4977-b0fe-6cc996bd1f3f tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115340 Oct 02 01:04:27.787283 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 441/873] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:27 2022] POST /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:04:27.853903 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.857190 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:27.857695 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:27.864442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.864921 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.865380 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.866070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.866328 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-16c8dc98-f0a9-4fef-b387-8c6f7e7e0b99 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1357 microversion: 2.1 time: 0.183792 Oct 02 01:04:27.866510 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.866927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.867635 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 433/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:27 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:27.967045 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lazy-loading 'services' on Instance uuid 6dbd4bd7-3924-4adc-98f4-a83f5372676b {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:28.049934 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a1de42c7-e449-4a4e-afaa-651599ba6fa7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments/f6def437-c3df-4e48-aaa4-dcf04a827012" status: 202 len: 0 microversion: 2.1 time: 0.196961 Oct 02 01:04:28.050533 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 442/875] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:04:27 2022] DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments/f6def437-c3df-4e48-aaa4-dcf04a827012 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:04:28.059864 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.062420 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:28.068792 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.069321 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.069756 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.070845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.071342 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.071736 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.105923 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-98b5c905-b282-4dfa-a10a-9ec98ed0abad tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050605 Oct 02 01:04:28.106519 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 434/876] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:28.899922 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.900728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:28.908145 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.908796 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.909181 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.909892 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.910358 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.910825 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.045786 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.053863 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-33543195-18b8-44ac-8a56-3c71e3f4de86 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1547 microversion: 2.1 time: 0.163303 Oct 02 01:04:29.054494 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 443/877] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:29.077356 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.077980 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.084507 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.085209 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.085661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.086464 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.086932 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.087362 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.118942 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.121929 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.128016 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.128428 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.128858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.129579 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.130216 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.130739 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.165115 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-d017a3b6-7f46-4a3b-9b97-3baeb46b86b1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050033 Oct 02 01:04:29.165689 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 444/878] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:04:29.225199 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.233270 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-34ebeae2-7a81-41b8-b4e9-197473058ef6 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1547 microversion: 2.1 time: 0.160260 Oct 02 01:04:29.233853 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 435/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:29.235672 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.236570 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.243747 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.244237 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.244674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.245395 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.246363 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.246790 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.257020 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.262832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.263651 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Searching by: {'deleted': False, 'project_id': '76adee9ec65f48b0b6e582800bc46a62'} {{(pid=120759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:04:29.270933 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.271550 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.271992 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.272761 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.273257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.273688 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.276282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:04:29.329545 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.360051 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-a276ffca-466f-4f15-8375-65979fd23e1b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 204 len: 0 microversion: 2.1 time: 0.129763 Oct 02 01:04:29.364228 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 445/880] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:29 2022] DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:04:29.368874 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.multi_cell_list [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:04:29.370046 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.371333 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.377658 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.378191 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.378568 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.379272 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.379730 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.380143 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.468684 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2ff5a574-eddc-4349-b5d0-9d545595b802 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215408 Oct 02 01:04:29.469311 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 436/881] 10.222.0.26 () {58 vars in 1125 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:29.481623 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.482253 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.488192 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.488973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.489527 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.490233 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.490694 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.491129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.520313 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.528619 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9f4b3ef6-1b16-4a69-9678-8a7989692845 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1682 microversion: 2.1 time: 0.162654 Oct 02 01:04:29.529472 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 446/882] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:29.623475 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.631493 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-79f4927d-1d25-43d6-bd13-c2752ab025c0 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1547 microversion: 2.1 time: 0.154246 Oct 02 01:04:29.632152 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 437/883] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:30.552243 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.552852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:30.559306 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.559798 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.560241 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.560932 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.561426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.561858 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.691846 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:30.700542 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-dcbfb817-7a34-48f6-b1b4-cf15339c29b8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1682 microversion: 2.1 time: 0.152105 Oct 02 01:04:30.701149 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 447/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:30 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:31.208594 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34205c4b-a000-48b8-b472-f5301c385188"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:31.211065 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:31.218315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.218823 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.219268 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.219976 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.220505 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.220857 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.475557 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:31.500288 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d48b4378-a3c0-45f5-a29b-7f92c01147e4 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295447 Oct 02 01:04:31.500915 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 438/885] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:31 2022] POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:31.724160 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:31.724781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:31.733967 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.734404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.734840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.735628 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.736076 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.736526 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.805316 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:31.814507 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7198d8dd-ef3c-4821-9098-5a07d5aa6104 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1614 microversion: 2.1 time: 0.094332 Oct 02 01:04:31.815090 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 448/886] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:31 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:31.981152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbd4bd7-3924-4adc-98f4-a83f5372676b", "name": "network-vif-deleted", "tag": "f1b396b3-dae6-4ec4-88c3-b403411dffe2"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:31.991613 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.992104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.992542 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.004623 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] Creating event network-vif-deleted:f1b396b3-dae6-4ec4-88c3-b403411dffe2 for instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b on hv-cinder-maste Oct 02 01:04:32.009936 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-1d8a4dc1-d216-4137-94f1-6323f9b3d77c req-095de553-2b79-49cd-b530-ff664f6986c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Oct 02 01:04:32.010786 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 439/887] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:04:32.840571 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:32.841934 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:32.848867 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.849397 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.849840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.850610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.851057 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.851689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.896451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.897370 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.897840 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.898305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.objects.instance [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lazy-loading 'fault' on Instance uuid 6dbd4bd7-3924-4adc-98f4-a83f5372676b {{(pid=120760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:32.960282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:32.978127 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-6ac8b560-2821-48cc-8b0f-1d7a2cebf263 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 200 len: 1331 microversion: 2.1 time: 0.137892 Oct 02 01:04:32.978771 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 449/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:32 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:33.835797 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:33.836513 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:33.842896 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.843392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.843832 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.844522 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.845009 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.845443 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.985289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:33.994195 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-919b3c4a-c514-4ca6-884a-61a4639e2dea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1593 microversion: 2.1 time: 0.162938 Oct 02 01:04:33.994779 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 440/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:33 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:34.006339 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.007095 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:34.014283 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.014783 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.015233 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.015951 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.016471 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.016909 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.031546 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b HTTP/1.1 Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:04:34.034250 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:04:34.036191 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '6dbd4bd7-3924-4adc-98f4-a83f5372676b'} Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:34.037172 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:04:34.038686 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:34.040030 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:34.040030 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2d199b7a-b1c5-465a-ac43-db73a0d3c2f7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 404 len: 111 microversion: 2.1 time: 0.033981 Oct 02 01:04:34.040030 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 450/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:34.052314 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-ae9ce3ca-f09f-44bc-a7df-c13f5f60daba tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '.version_select at 0x7feb04c98c10>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.077628 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-ae9ce3ca-f09f-44bc-a7df-c13f5f60daba tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137360459" status: 202 len: 0 microversion: 2.1 time: 0.035520 Oct 02 01:04:34.078351 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 441/891] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137360459 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:35.127040 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-e576fc9c-7810-45fc-8965-18bd6db91ec9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: .version_select at 0x7feb04807280>, body: {"keypair": {"name": "tempest-keypair-1756304955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSMhYaZ9sSbJN/LnHFPhGWYKITZkCqPKD5ALfd7+RQt2u+xnPlVTY2tgfTDdNOZM7oOlhvao0PMTDBUwWMtoNjN1Pv0TqUvMevB+eXn56oAkwIHu1QcOXenvsMAUn/wJQ=="}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:35.147594 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-e576fc9c-7810-45fc-8965-18bd6db91ec9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:35.152774 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-e576fc9c-7810-45fc-8965-18bd6db91ec9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'key_pairs'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:35.176066 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-e576fc9c-7810-45fc-8965-18bd6db91ec9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052869 Oct 02 01:04:35.176661 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 451/892] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 2 01:04:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:36.098785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:36.114998 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.115835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.116538 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.139328 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] Creating event network-changed:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:04:36.150412 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-a07c4cb7-9e99-4b72-880f-aa3d9ca5acbc req-2b3e238f-50fa-4ca0-8ab3-cb0e0dc5fc69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054753 Oct 02 01:04:36.154329 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 442/893] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:37.200630 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-690627633", "imageRef": "8d33b496-298c-4559-864b-35a351aa5152", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17d77a0a-6f79-4f56-8106-1a30e4953c88"}], "security_groups": [{"name": "tempest-securitygroup--899129223"}], "key_name": "tempest-keypair-1756304955", "user_data": "}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:37.361450 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.network.neutron [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] validate_networks() for [('17d77a0a-6f79-4f56-8106-1a30e4953c88', None, None, None, None, None)] {{(pid=120760) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:37.775429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-331424305"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:37.776057 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:37.783305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.783807 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.784232 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.784981 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.785451 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.785871 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.866416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:37.866833 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image limits 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:37.867305 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Flavor pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:37.867715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Image pref 0:0:0 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:37.868123 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.virt.hardware [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:37.877896 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.878381 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.878819 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.879547 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.879999 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.880468 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.902027 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:37.906156 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.quota [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Getting quotas for user 3fe1c1254c2b4d98942176ce0c0f2502 and project 3b55505c96e44c6790ae56842ac5269a. Resources: {'instances', 'ram', 'cores'} {{(pid=120760) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:37.918302 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Going to run 1 instances... {{(pid=120760) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:37.920745 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d33b496-298c-4559-864b-35a351aa5152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:37.950698 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.network.security_group_api [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Adding security group aaf3f51d-9f03-40dc-b3b5-31a459b1f320 to port f397b638-6084-4db0-b2b3-74943ea78b55 Oct 02 01:04:37.978462 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5bc45666-6057-46b2-8ba7-76d320b3fe25 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.782952 Oct 02 01:04:37.979519 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 452/894] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:04:37.991917 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8b9b460a-589c-42d4-80b6-25b03d2e3014 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:37.992887 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8b9b460a-589c-42d4-80b6-25b03d2e3014 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:38.075452 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8b9b460a-589c-42d4-80b6-25b03d2e3014 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.083454 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8b9b460a-589c-42d4-80b6-25b03d2e3014 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1241 microversion: 2.1 time: 0.095684 Oct 02 01:04:38.084348 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 453/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:37 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:38.349003 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f3880751-d2c2-40d6-9837-5f30bdb3c685 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action" status: 202 len: 0 microversion: 2.1 time: 0.578311 Oct 02 01:04:38.357951 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 443/896] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:04:37 2022] POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:04:38.365873 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.366692 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:38.374535 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:38.384715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:38.396988 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.397448 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:38.399945 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.400718 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.401312 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.402814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.403842 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.404966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.405671 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.409940 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.439681 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] Creating event network-changed:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:04:38.445557 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-e6b0a4fb-9877-46a7-89d0-0f14712b2bb9 req-a3916600-9b5f-4634-b447-6d87a3b5c8a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090532 Oct 02 01:04:38.446809 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 454/897] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:38.615303 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.625664 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-557ed6dc-90fd-4204-9dd9-93da93ed974f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1756 microversion: 2.1 time: 0.266107 Oct 02 01:04:38.626861 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 444/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:39.116549 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.117207 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.125197 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.125698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.126547 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.126852 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.127602 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.127749 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.196341 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:39.204975 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-69c213e2-6d1e-440f-bd37-80bc4bab2730 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1293 microversion: 2.1 time: 0.093356 Oct 02 01:04:39.205831 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 455/899] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:40.229066 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:40.229863 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:40.232339 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell0:SELECT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:40.240877 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.241416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.241854 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.242576 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.243032 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.243462 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.392520 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:40.403512 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1484e948-0a6d-4aaf-ac3b-709abf0e100e tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.179452 Oct 02 01:04:40.419133 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 445/900] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:40 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:40.905330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd4059f-fb0f-4a32-8312-8beb517eca1e", "tag": "10a1a3a5-5184-4c46-93fe-38048e7696b8"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:40.916927 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.918001 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.918764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.930772 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] Creating event network-changed:10a1a3a5-5184-4c46-93fe-38048e7696b8 for instance abd4059f-fb0f-4a32-8312-8beb517eca1e on hv-cinder-maste Oct 02 01:04:40.936732 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-dc99bbc2-d62a-4fc2-acfd-e8b1836b117e req-a7106568-6ac9-46fa-ba86-777dec62bb87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035179 Oct 02 01:04:40.937582 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 456/901] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:41.431742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:41.432368 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:41.439905 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:41.440396 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:41.440843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:41.441597 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:41.442050 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:41.442479 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:41.605972 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:41.615455 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-135143a6-544f-4e54-a5fd-818e50385fe9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.187516 Oct 02 01:04:41.616143 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 446/902] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:41 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:42.562691 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:42.563272 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:42.570568 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.571070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.571528 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.572231 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.572689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.573177 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.601595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:04:42.640201 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:42.641646 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:42.649132 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.649965 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.650402 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.651344 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.652156 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.652760 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.732104 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-9c2758b3-b19f-4b8c-bd21-5946a4fd6462 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "DELETE /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 204 len: 0 microversion: 2.1 time: 0.169680 Oct 02 01:04:42.733413 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 457/903] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:42 2022] DELETE /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:04:42.747689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:42.748822 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:42.758046 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.758867 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.759486 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.760609 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.762412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.763078 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.890454 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:42.900890 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1f914407-b863-460e-8365-7ea4e433ffe2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.264264 Oct 02 01:04:42.911758 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 447/904] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:42 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:42.953969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:42.954942 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:42.963572 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-50975f2f-f4d7-4652-ae34-90973c214695 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.225399 Oct 02 01:04:42.964422 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 458/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:42 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:42.966624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.966624 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.967068 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.990642 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.compute.server_external_events [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] Creating event network-changed:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:04:42.996694 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [req-1591a909-cabb-4c21-9c6d-a8855edb9faf req-a3839392-7fa6-491d-b9a7-d01b986298d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045877 Oct 02 01:04:42.997366 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 448/906] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:43.923872 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.924477 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:43.931330 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.931700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.932138 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.933659 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.934135 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.935780 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.989247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.989958 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:43.998282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.998645 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.999091 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.999812 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.000297 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.000724 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.148486 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:44.157800 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-79e88891-b468-4f57-98b4-56b5c952f834 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.237265 Oct 02 01:04:44.158197 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 459/907] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:44.180457 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:44.189258 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-877f208d-a72d-49f8-a514-623ef5508454 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1568 microversion: 2.1 time: 0.204674 Oct 02 01:04:44.190339 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 449/908] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:44.934781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c4e1ea-ed27-499a-8b60-cf70c3cf3a84", "name": "network-vif-deleted", "tag": "2b3c36c0-4d71-45cc-9b31-f2772035a5eb"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:44.945769 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.946595 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.947036 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.962166 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] Creating event network-vif-deleted:2b3c36c0-4d71-45cc-9b31-f2772035a5eb for instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 on hv-cinder-maste Oct 02 01:04:44.969008 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-20e26b20-500b-4b4f-bb87-d9716efb126d req-33c4a0a5-9bf5-4e7d-9f19-e6cc6a258842 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038182 Oct 02 01:04:44.970608 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 460/909] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:45.182252 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.183497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:45.190399 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.190907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.191357 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.192085 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.192571 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.192994 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.217715 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.218427 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:45.227451 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.227951 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.228396 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.229142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.230398 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.230837 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.330521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9b96e5011b41fe8a496252e77f4be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:45.342061 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1a4d3d23-c070-4bf5-b429-5490b08d2b5c tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 200 len: 1219 microversion: 2.1 time: 0.131338 Oct 02 01:04:45.343078 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 461/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:45.423300 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:45.435280 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-cd4f4d59-c79a-4ce4-b703-f6bad0b52f01 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.257047 Oct 02 01:04:45.449507 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:46.371402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.372411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] [instance: 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:46.383369 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.385165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.386585 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.387885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.389538 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.390312 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.417236 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] HTTP exception thrown: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Request method failure captured: Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 HTTP/1.1 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOKrw9pbXhqfc-hwaM8BHYwFuDKN0V0x5TNp7-_i0Mdap5gZT8bE6reRqU6t9ImBt__-L-KJ-bOYR6pybFbJImQKHfitz6rok3FbJE1W5hWX5j8DkB4iYCTiZn7uhyYxcTONNXrvgo-loswpLFK2JiieEXqK0g6aKuYwezeSukUAVKg Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: a79ddf414b9f4b0aa6a09cd54c747e08 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-TestShelveInstance-519788508 Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:04:46.420527 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a79ddf414b9f4b0aa6a09cd54c747e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a79ddf414b9f4b0aa6a09cd54c747e08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a79ddf414b9f4b0aa6a09cd54c747e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a79ddf414b9f4b0aa6a09cd54c747e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-TestShelveInstance-519788508 Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: a79ddf414b9f4b0aa6a09cd54c747e08 Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-TestShelveInstance-519788508 Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-TestShelveInstance-519788508-project Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 9d9b96e5011b41fe8a496252e77f4be6 Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-TestShelveInstance-519788508-project Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. Oct 02 01:04:46.422158 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '79c4e1ea-ed27-499a-8b60-cf70c3cf3a84'} Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:46.423044 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. Oct 02 01:04:46.424679 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:04:46.426497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Returning 404 to user: Instance 79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:46.426497 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-5a60815a-ee3c-41e3-8adb-c4c5282790dd tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84" status: 404 len: 111 microversion: 2.1 time: 0.058470 Oct 02 01:04:46.426497 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 462/912] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:46 2022] GET /compute/v2.1/servers/79c4e1ea-ed27-499a-8b60-cf70c3cf3a84 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:46.463223 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.465805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:46.474326 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.475067 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.475639 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.476600 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.477266 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.477951 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.706897 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.718289 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3a87b838-abf7-4b98-8698-dbeb606c631a tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.261314 Oct 02 01:04:46.730200 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 451/913] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:46 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:46.767411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-55347c99-89b1-4d17-8bc4-17dc2dda6f09 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] Calling method '.version_select at 0x7feb0485f790>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.791245 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-55347c99-89b1-4d17-8bc4-17dc2dda6f09 tempest-TestShelveInstance-519788508 tempest-TestShelveInstance-519788508-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-539083247" status: 202 len: 0 microversion: 2.1 time: 0.028490 Oct 02 01:04:46.792369 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 463/914] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 2 01:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-539083247 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:47.756709 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:47.757875 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:47.766603 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.767392 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.767944 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:47.768844 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.769547 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.770104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:48.014759 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:48.023652 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0f6ab377-5a38-492b-ac6f-59d0022c05fc tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.272148 Oct 02 01:04:48.024240 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 452/915] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:47 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:48.370689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd4059f-fb0f-4a32-8312-8beb517eca1e", "name": "network-vif-plugged", "status": "completed", "tag": "10a1a3a5-5184-4c46-93fe-38048e7696b8"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:48.380323 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:48.382973 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell0:SELECT=12 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:48.393423 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:48.394605 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:48.395304 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:48.411273 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] Creating event network-vif-plugged:10a1a3a5-5184-4c46-93fe-38048e7696b8 for instance abd4059f-fb0f-4a32-8312-8beb517eca1e on hv-cinder-maste Oct 02 01:04:48.421393 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-bd998f4f-9f08-4a83-b39e-56f082ff3111 req-711ea314-270f-4b29-870a-1046a50baa52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054427 Oct 02 01:04:48.423498 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 464/916] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:49.051931 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:49.052497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.059590 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.060282 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.060904 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.061810 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.062422 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.063238 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.289477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:49.297830 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-92a4e690-852c-404a-8fbe-56eaacbdf198 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1366 microversion: 2.1 time: 0.249840 Oct 02 01:04:49.298522 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 453/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:49 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:50.325106 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.326732 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.357174 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.361857 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.362482 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.363551 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.364148 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.365213 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.607116 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:50.622856 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-7bf40b34-9834-437f-944f-28d18922c34c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1556 microversion: 2.1 time: 0.305711 Oct 02 01:04:50.623437 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1556 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:50.648921 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.655938 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.662924 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.663456 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.663974 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.664750 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.665212 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.665649 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.749284 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-d9c59c44-c702-4719-8511-5c9b1ae8b8c9 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104207 Oct 02 01:04:50.749874 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 454/919] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:52.649914 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd4059f-fb0f-4a32-8312-8beb517eca1e", "tag": "10a1a3a5-5184-4c46-93fe-38048e7696b8"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:52.674045 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:52.680982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:52.681741 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:52.696985 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] Creating event network-changed:10a1a3a5-5184-4c46-93fe-38048e7696b8 for instance abd4059f-fb0f-4a32-8312-8beb517eca1e on hv-cinder-maste Oct 02 01:04:52.705752 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-fca99897-6be6-485f-a06a-6db5c7af89b8 req-7583f08e-fced-4089-9ee7-baa2788a3d44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062618 Oct 02 01:04:52.707158 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 466/920] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:04.155079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=21 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.156263 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.160305 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:04.162756 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.171214 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.171705 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.172146 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.172852 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.173367 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.173797 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.251183 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bae2328c-6b37-4af0-8d0a-93ef9bcfb109 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action" status: 202 len: 0 microversion: 2.1 time: 0.097690 Oct 02 01:05:04.251734 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 455/921] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:05:04 2022] POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:04.262343 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.263720 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.266340 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.267406 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.274600 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.275096 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.276244 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.276966 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.277432 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.277851 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.516038 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:04.524385 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-101e25b1-fb86-4921-9077-d79e0fc225dc tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1748 microversion: 2.1 time: 0.268222 Oct 02 01:05:04.525346 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1748 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:05.548638 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:05.549416 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:05.555968 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.556459 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.557243 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.557950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.558413 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.558843 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.703125 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.711443 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6d71799c-112e-4739-b14b-edb11a624035 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.167506 Oct 02 01:05:05.712011 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 456/923] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:05 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.736521 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.737140 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.743874 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.744374 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.744817 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.745552 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.746009 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.746438 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.893063 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.901812 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-f50a04ef-e27c-4ec1-9f8b-56e31b01a4e5 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.169392 Oct 02 01:05:06.902368 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 468/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:07.926773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.927785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.935351 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.935845 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.936286 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.937015 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.937477 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.937907 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.084168 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:08.093142 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-6dbb5205-ee52-4eef-a25d-933ec384e646 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.170524 Oct 02 01:05:08.093713 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 457/925] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:09.116389 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.117030 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.123562 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.124053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.124499 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.125222 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.125686 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.126115 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.271537 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.280884 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-83deed7e-5b33-42f5-aa7d-a6b5625614bf tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.168697 Oct 02 01:05:09.281481 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 469/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:10.305207 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:10.305785 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.313143 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.313637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.314079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.314784 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.315244 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.315675 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.456596 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.466029 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-883a4f80-44e1-4b25-b89a-62d4851451ea tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.165183 Oct 02 01:05:10.466605 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 458/927] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:11.489996 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.490895 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:11.497497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.497982 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.498412 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.499105 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.499728 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.500324 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.649847 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:11.658873 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-8ee4d71e-2fd5-49fd-9851-6cc3cd5d8db2 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.173000 Oct 02 01:05:11.659442 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 470/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:11 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:12.682319 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.683794 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.695308 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.695818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.697373 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.698129 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.698593 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.699025 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.086995 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.095258 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-85696b94-df8d-406e-b28e-1b0641c62955 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.416826 Oct 02 01:05:13.095824 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 459/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:14.118997 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:14.119612 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:14.126871 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.127361 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.127802 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.128497 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.128984 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.129417 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.271632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.279975 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-66270fd8-ff2d-4b37-81bb-01458cb48948 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.164827 Oct 02 01:05:14.280542 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 471/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:15.303540 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.304105 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:15.310820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.311315 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.311758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.312466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.312927 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.313381 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.472387 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.480923 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2257c8fe-9c6f-482a-bf4a-f8ba141cba0c tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1753 microversion: 2.1 time: 0.181570 Oct 02 01:05:15.481521 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 460/931] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.503787 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.504407 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.510921 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.511409 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.511849 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.512543 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.513032 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.513461 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.657584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:16.667655 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-fcb3c1af-7d0e-4d5e-9f70-76aa60dada4f tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1756 microversion: 2.1 time: 0.166998 Oct 02 01:05:16.668366 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 472/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.922170 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.922779 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.929152 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.929637 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.930076 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.930756 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.931204 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.931654 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.956007 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a7af22dc-7c59-471a-97ad-179ef851be34 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/ips" status: 200 len: 149 microversion: 2.1 time: 0.037730 Oct 02 01:05:23.956574 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 461/933] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:25.291683 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3606fb56-2156-4095-9cb8-5a03a998cae9"}} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:25.294225 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.300823 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.301351 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.301793 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.302501 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.302957 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.303387 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.565552 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-57f6bb8c-80e2-4dd1-b783-e507812b52d8 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "POST /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277615 Oct 02 01:05:25.566426 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 473/934] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 2 01:05:25 2022] POST /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:27.925285 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.925902 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.932149 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.932629 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.933112 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.934432 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.934881 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.935333 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.015126 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lazy-loading 'services' on Instance uuid abd4059f-fb0f-4a32-8312-8beb517eca1e {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:28.089021 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-3408f8d4-8dbc-444d-a11d-541a5d4332f1 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments/3606fb56-2156-4095-9cb8-5a03a998cae9" status: 202 len: 0 microversion: 2.1 time: 0.167410 Oct 02 01:05:28.089627 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 462/935] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:05:27 2022] DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments/3606fb56-2156-4095-9cb8-5a03a998cae9 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:28.099404 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:28.101810 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:28.110784 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.111297 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.111751 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.112454 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.112910 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.113632 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.146551 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1d5a7a9f-0aae-4f59-a57c-35c8a05b1139 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052176 Oct 02 01:05:28.147125 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 474/936] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:29.160130 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.162512 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.169017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.169511 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.169950 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.170647 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.171104 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.171531 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.203034 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-511217f6-adbe-482b-91ce-9ce9c4360bc3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047673 Oct 02 01:05:29.203597 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 463/937] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:05:29.267217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.267764 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.274054 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.274548 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.274986 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.275689 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.276144 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.276570 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.303086 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Going to try to terminate instance {{(pid=120760) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:29.379604 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-339af039-b306-4061-a319-55c2dec346de tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 204 len: 0 microversion: 2.1 time: 0.116064 Oct 02 01:05:29.380275 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 475/938] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:29 2022] DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:29.388915 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.389630 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.395539 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.396014 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.396447 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.397188 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.397644 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.398062 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.532191 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:29.539922 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-2498860c-2b2d-43d4-9f9c-3045567792d3 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1680 microversion: 2.1 time: 0.154901 Oct 02 01:05:29.540487 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 464/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:30.563584 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:30.564320 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:30.570777 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.571265 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.571700 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.572394 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.572853 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.573309 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.703681 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:30.711837 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-2035d2cb-0085-43e6-b587-e8322df44323 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1680 microversion: 2.1 time: 0.152496 Oct 02 01:05:30.712414 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 476/940] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:30 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:31.736017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:31.736758 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:31.744095 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.744677 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.745247 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.745990 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.746425 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.747158 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.817818 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe1c1254c2b4d98942176ce0c0f2502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b55505c96e44c6790ae56842ac5269a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:31.826227 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-bb201630-a91d-4612-bb72-b3d69aed924b tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 200 len: 1613 microversion: 2.1 time: 0.093749 Oct 02 01:05:31.826808 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 465/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:31 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:32.092403 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd4059f-fb0f-4a32-8312-8beb517eca1e", "name": "network-vif-deleted", "tag": "10a1a3a5-5184-4c46-93fe-38048e7696b8"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:32.102772 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.103264 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.103702 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.116317 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] Creating event network-vif-deleted:10a1a3a5-5184-4c46-93fe-38048e7696b8 for instance abd4059f-fb0f-4a32-8312-8beb517eca1e on hv-cinder-maste Oct 02 01:05:32.121740 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-360139b9-d085-4a90-bc96-d1b0b35baa49 req-7e24a67a-5d77-4258-a319-e547bcc8c6e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Oct 02 01:05:32.123480 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 477/942] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:32.851039 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.851574 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:32.858999 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.859515 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.859952 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.860651 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.861141 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.861592 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.876322 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e HTTP/1.1 Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:05:32.878017 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:32.879678 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'abd4059f-fb0f-4a32-8312-8beb517eca1e'} Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:32.880746 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:32.882443 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:32.884289 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:32.884289 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-0176ffa3-d955-4a20-adb7-a68c11ccabe5 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 404 len: 111 microversion: 2.1 time: 0.032367 Oct 02 01:05:32.884289 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 466/943] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:32 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:32.890503 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-efde956b-b445-4f03-ba55-ba3f4113baa2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '.version_select at 0x7feb0475c160>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.911212 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-efde956b-b445-4f03-ba55-ba3f4113baa2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756304955" status: 202 len: 0 microversion: 2.1 time: 0.025149 Oct 02 01:05:32.911956 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 478/944] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 2 01:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756304955 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:34.672879 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.673458 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:34.675789 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=25 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:34.681170 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.681661 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.682378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.682805 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.683264 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.683692 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.686688 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:34.699607 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e HTTP/1.1 Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:05:34.701834 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.703508 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'abd4059f-fb0f-4a32-8312-8beb517eca1e'} Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:34.704584 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.706129 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.707754 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:34.707754 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-45410e0a-40fb-48e8-8a7e-40faad9ed685 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 404 len: 111 microversion: 2.1 time: 0.034597 Oct 02 01:05:34.707754 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 467/945] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:34 2022] DELETE /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:34.713165 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.713940 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: abd4059f-fb0f-4a32-8312-8beb517eca1e] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:34.716915 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:34.723868 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.724357 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.724797 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.725532 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.726013 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.726442 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.729748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:34.743626 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e HTTP/1.1 Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:34.745667 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.747245 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'abd4059f-fb0f-4a32-8312-8beb517eca1e'} Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:34.748285 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. Oct 02 01:05:34.749597 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:34.750714 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance abd4059f-fb0f-4a32-8312-8beb517eca1e could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:34.750714 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-632ea631-66f4-476e-bb75-c63fea49c4ef tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e" status: 404 len: 111 microversion: 2.1 time: 0.037932 Oct 02 01:05:34.750714 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:34 2022] GET /compute/v2.1/servers/abd4059f-fb0f-4a32-8312-8beb517eca1e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:35.891673 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.892195 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.898741 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.899257 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.899727 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.900429 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.900887 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.901343 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.915359 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b HTTP/1.1 Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:05:35.916930 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.918510 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '6dbd4bd7-3924-4adc-98f4-a83f5372676b'} Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:35.920169 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.921500 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.922926 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:35.922926 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c85dfa3b-d150-4694-87f4-58d2aef0896d tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 404 len: 111 microversion: 2.1 time: 0.031003 Oct 02 01:05:35.922926 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 468/947] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:35 2022] DELETE /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:35.928142 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.928748 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 6dbd4bd7-3924-4adc-98f4-a83f5372676b] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.935559 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.936040 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.936473 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.937185 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.937634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.938085 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.951315 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b HTTP/1.1 Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:35.952806 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.954506 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '6dbd4bd7-3924-4adc-98f4-a83f5372676b'} Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:35.955408 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. Oct 02 01:05:35.956967 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.958255 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 6dbd4bd7-3924-4adc-98f4-a83f5372676b could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:35.958255 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-30b61972-fb86-4a25-b474-fdf513b3fa77 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b" status: 404 len: 111 microversion: 2.1 time: 0.029866 Oct 02 01:05:35.958255 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 480/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/6dbd4bd7-3924-4adc-98f4-a83f5372676b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:35.962774 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.963276 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.969820 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.970304 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.970742 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.971426 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.971918 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.972345 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.986287 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 HTTP/1.1 Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:05:35.987841 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:35.989746 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': '14da718c-8c95-4157-95c3-93bb32b37381'} Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:35.990664 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:35.992237 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:35.994086 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:35.994086 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-1e2c4de7-155d-44d3-b59b-f6145df1d3c2 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 404 len: 111 microversion: 2.1 time: 0.030648 Oct 02 01:05:35.994086 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 469/949] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:35 2022] DELETE /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:35.997814 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.998523 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: 14da718c-8c95-4157-95c3-93bb32b37381] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:36.004325 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.004803 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.005266 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.005944 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.006390 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.006807 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.020783 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 HTTP/1.1 Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:36.022313 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:36.023987 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': '14da718c-8c95-4157-95c3-93bb32b37381'} Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:36.024900 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. Oct 02 01:05:36.026489 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:36.027820 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance 14da718c-8c95-4157-95c3-93bb32b37381 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:36.027820 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-3b1f88bc-f52f-40be-85a1-4325bbaeb0c7 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381" status: 404 len: 111 microversion: 2.1 time: 0.029522 Oct 02 01:05:36.027820 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 481/950] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/14da718c-8c95-4157-95c3-93bb32b37381 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:37.164437 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.164968 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.171973 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.172466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.172909 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.173635 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.174099 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.174533 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.188623 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.wsgi [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: request: DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 HTTP/1.1 Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept: application/json Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Accept-Encoding: identity Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Connection: close Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Length: 0 Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Content-Type: application/json Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Host: 10.222.0.26 Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: Openstack-System-Scope: None Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Id: None Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Domain-Name: None Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Identity-Status: Confirmed Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Is-Admin-Project: True Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Id: default Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Domain-Name: Default Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Role: member,reader Oct 02 01:05:37.190193 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Roles: member,reader Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Id: default Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Domain-Name: Default Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: method: > Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: exception: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.191819 dv-cinder-master-3-smb devstack@n-api.service[120759]: action_args: {'id': 'd2055e3b-ffcc-4bcd-bbcb-ac45c5d18522'} Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:37.193070 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.194551 dv-cinder-master-3-smb devstack@n-api.service[120759]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.196356 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. {{(pid=120759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:37.196356 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-683c5f34-4091-4608-b102-7d6791ae3c44 tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 404 len: 111 microversion: 2.1 time: 0.031003 Oct 02 01:05:37.196356 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 470/951] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:37 2022] DELETE /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:37.200043 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.200694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] [instance: d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.207148 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.207634 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.208074 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.208767 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.209259 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.209693 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.223157 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] HTTP exception thrown: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Request method failure captured: Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 HTTP/1.1 Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOOLwI8MIChPe8HkUBVWMYgDr9YlMl_otxoWrivxhCLCf2qodwzl1Gv1Mb1stYS-ol-wsJApThYDxgZq-2bER6ZO5RObicehE4kbibkeTbU2ouOixlgdkjZu8TADJp5eUHP9n4CYbhvMdwwK7HhZaRxcoNkzuT5ldchut6noWviF71hI Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:37.224673 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b55505c96e44c6790ae56842ac5269a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 3b55505c96e44c6790ae56842ac5269a Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574662584 Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: 3fe1c1254c2b4d98942176ce0c0f2502 Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-AttachVolumeNegativeTest-574662584-project Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.226507 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'd2055e3b-ffcc-4bcd-bbcb-ac45c5d18522'} Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:37.227440 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. Oct 02 01:05:37.228680 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:37.229945 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] Returning 404 to user: Instance d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:37.229945 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-69766c1b-d5b8-422e-89bc-3ff635c1749c tempest-AttachVolumeNegativeTest-574662584 tempest-AttachVolumeNegativeTest-574662584-project] 10.222.0.26 "GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522" status: 404 len: 111 microversion: 2.1 time: 0.029953 Oct 02 01:05:37.229945 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 482/952] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/d2055e3b-ffcc-4bcd-bbcb-ac45c5d18522 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:49.037752 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-331424305"}} {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:49.038356 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:49.040497 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_api:SELECT=7 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:49.041173 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG dbcounter [-] [120759] Writing DB stats nova_cell1:SELECT=7 {{(pid=120759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:49.047332 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.047835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.048279 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.049018 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.049499 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.049910 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.192482 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.network.security_group_api [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Removing security group aaf3f51d-9f03-40dc-b3b5-31a459b1f320 from port f397b638-6084-4db0-b2b3-74943ea78b55 Oct 02 01:05:49.513901 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-f0b72a62-572a-43a5-8fb1-c8f5e294f14e tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action" status: 202 len: 0 microversion: 2.1 time: 0.479489 Oct 02 01:05:49.518834 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 471/953] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 2 01:05:49 2022] POST /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:49.548990 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:49.576698 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_api:SELECT=7 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:49.577701 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG dbcounter [-] [120760] Writing DB stats nova_cell1:SELECT=7 {{(pid=120760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:49.583679 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.584209 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.584593 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.606119 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] Creating event network-changed:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:05:49.612499 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-2937d553-2714-41aa-a99b-ab89924b2147 req-839059f6-6788-4517-8910-94378a46c60a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072174 Oct 02 01:05:49.614533 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 483/954] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:51.017699 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.018837 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:51.019417 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:51.029266 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.029754 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.030376 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.030940 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.031674 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.032466 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.033773 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.034652 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.035462 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.042327 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] Creating event network-changed:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:05:51.047241 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-fa18c0c5-e775-48c7-a11e-355d0220c91a req-338c506c-818a-4c01-a06e-32fb6626f0c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032321 Oct 02 01:05:51.051503 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 484/955] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:51.151378 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.objects.instance [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lazy-loading 'services' on Instance uuid ab6cb71c-1735-41c2-be0c-e98a7834df70 {{(pid=120759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:51.237513 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-b5fe98d5-36a6-446a-b25e-26512187cd24 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments/34205c4b-a000-48b8-b472-f5301c385188" status: 202 len: 0 microversion: 2.1 time: 0.223964 Oct 02 01:05:51.242716 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 472/956] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:05:51 2022] DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments/34205c4b-a000-48b8-b472-f5301c385188 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:51.249458 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.252694 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:51.261941 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.262436 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.263416 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.265969 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.266563 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.267217 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.310906 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-1c9fa39e-6b4c-4bc6-acd8-6c1a76bced4a tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064739 Oct 02 01:05:51.317040 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 485/957] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:52.324335 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:52.326808 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:52.333433 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.333919 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.334353 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.335041 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.335496 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.335919 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.368479 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-c0f6071c-b310-4e83-bb1a-32f1808a4922 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048373 Oct 02 01:05:52.369074 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 473/958] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:52 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:05:52.379885 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:52.380427 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:52.386610 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.387097 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.387534 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.388380 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.389064 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.389494 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.472394 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] HTTP exception thrown: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 is not attached to volume 34205c4b-a000-48b8-b472-f5301c385188 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Request method failure captured: Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments/34205c4b-a000-48b8-b472-f5301c385188 HTTP/1.1 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOON54dcG-r_PF_i8XnknhqxQXCuFt4KOmDODyWqDzghbtUZPDsbPdWcbmKog32RcXHbo_Ql29NlR0JRAD9tmBuDvi2QU0cgLJpujub77J0yOQGeaMUX1ENTuYH7BssnmiHePj7CKvSfXTHULN3vnas1qKHxOCrKmMfGFqm3DhybhpVQ Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 76adee9ec65f48b0b6e582800bc46a62 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:52.475070 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 76adee9ec65f48b0b6e582800bc46a62 Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-TestMinimumBasicScenario-1363935370-project Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: ba7722296ce14931bc49d3c2912e56f0 Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-TestMinimumBasicScenario-1363935370-project Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:52.476776 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 is not attached to volume 34205c4b-a000-48b8-b472-f5301c385188 Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'server_id': 'ab6cb71c-1735-41c2-be0c-e98a7834df70', 'id': '34205c4b-a000-48b8-b472-f5301c385188'} Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 34205c4b-a000-48b8-b472-f5301c385188. Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:52.477720 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 is not attached to volume 34205c4b-a000-48b8-b472-f5301c385188 Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 is not attached to volume 34205c4b-a000-48b8-b472-f5301c385188 Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:52.479216 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Returning 404 to user: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 is not attached to volume 34205c4b-a000-48b8-b472-f5301c385188 {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:52.480376 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-bf1867a6-fbb4-4cf4-b6ff-e754a1f08960 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments/34205c4b-a000-48b8-b472-f5301c385188" status: 404 len: 154 microversion: 2.1 time: 0.100598 Oct 02 01:05:52.480376 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 486/959] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 2 01:05:52 2022] DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70/os-volume_attachments/34205c4b-a000-48b8-b472-f5301c385188 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:53.627310 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.627835 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:53.634267 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.634759 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.635199 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.635898 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.636394 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.636824 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.662197 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Going to try to terminate instance {{(pid=120759) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:53.737632 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-181c0618-5fd4-4ab1-810a-05e6d41e76db tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 204 len: 0 microversion: 2.1 time: 0.114669 Oct 02 01:05:53.738226 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 474/960] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:53 2022] DELETE /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:53.751829 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.753086 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:53.762426 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.762926 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.763402 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.764103 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.764564 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.765249 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.900053 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.policy [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120760) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:53.908871 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-c8e1b1aa-1ff7-4f97-a0b3-815bd06e7473 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1553 microversion: 2.1 time: 0.164819 Oct 02 01:05:53.909467 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 487/961] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.932982 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.933656 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.942581 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.943079 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.944716 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.945474 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.945959 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.946376 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.078930 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:55.086802 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-a0354475-3383-45b6-87fe-c73269a023be tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1553 microversion: 2.1 time: 0.158227 Oct 02 01:05:55.087362 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 475/962] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:56.051282 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6cb71c-1735-41c2-be0c-e98a7834df70", "name": "network-vif-deleted", "tag": "f397b638-6084-4db0-b2b3-74943ea78b55"}]} {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:56.065753 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.066262 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.066830 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.080430 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.compute.server_external_events [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] Creating event network-vif-deleted:f397b638-6084-4db0-b2b3-74943ea78b55 for instance ab6cb71c-1735-41c2-be0c-e98a7834df70 on hv-cinder-maste Oct 02 01:05:56.085845 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [req-e1635c82-8941-4dd0-94e6-a8d6de29d46f req-7f31bbbc-2a7c-4264-94ee-9956ee23a2ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038327 Oct 02 01:05:56.086837 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 488/963] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:56.117747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.117747 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.compute.api [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120759) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.127102 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.127650 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.128087 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.128895 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.129414 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.129838 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG oslo_concurrency.lockutils [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.204195 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.policy [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7722296ce14931bc49d3c2912e56f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76adee9ec65f48b0b6e582800bc46a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120759) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:56.212076 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-cea8def9-0d54-4fe8-ba33-c297f6328c79 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 200 len: 1342 microversion: 2.1 time: 0.105979 Oct 02 01:05:56.212648 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 476/964] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:56 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 1342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:57.238016 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '>' {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.239094 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.compute.api [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] [instance: ab6cb71c-1735-41c2-be0c-e98a7834df70] Fetching instance by UUID {{(pid=120760) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:57.245674 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.246172 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.246621 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.247321 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Acquiring lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.247781 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.248210 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG oslo_concurrency.lockutils [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Lock "92ecf1a6-18c4-4177-88e4-8ad45652d4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.263038 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.wsgi [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] HTTP exception thrown: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Request method failure captured: Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: request: GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 HTTP/1.1 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept: application/json Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Accept-Encoding: identity Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Connection: close Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Length: 0 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Content-Type: application/json Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Host: 10.222.0.26 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: Openstack-System-Scope: None Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Auth-Token: gAAAAABjOON54dcG-r_PF_i8XnknhqxQXCuFt4KOmDODyWqDzghbtUZPDsbPdWcbmKog32RcXHbo_Ql29NlR0JRAD9tmBuDvi2QU0cgLJpujub77J0yOQGeaMUX1ENTuYH7BssnmiHePj7CKvSfXTHULN3vnas1qKHxOCrKmMfGFqm3DhybhpVQ Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Id: None Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Domain-Name: None Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Identity-Status: Confirmed Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Is-Admin-Project: True Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Id: default Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Domain-Name: Default Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Id: 76adee9ec65f48b0b6e582800bc46a62 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Project-Name: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Role: member,reader Oct 02 01:05:57.265355 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Roles: member,reader Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76adee9ec65f48b0b6e582800bc46a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Id: 76adee9ec65f48b0b6e582800bc46a62 Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1363935370 Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User: tempest-TestMinimumBasicScenario-1363935370-project Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Id: default Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Domain-Name: Default Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Id: ba7722296ce14931bc49d3c2912e56f0 Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: X-User-Name: tempest-TestMinimumBasicScenario-1363935370-project Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: method: > Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: exception: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. Oct 02 01:05:57.267011 dv-cinder-master-3-smb devstack@n-api.service[120760]: action_args: {'id': 'ab6cb71c-1735-41c2-be0c-e98a7834df70'} Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: {{(pid=120760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:57.267955 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. Oct 02 01:05:57.269246 dv-cinder-master-3-smb devstack@n-api.service[120760]: ERROR nova.api.openstack.wsgi Oct 02 01:05:57.270411 dv-cinder-master-3-smb devstack@n-api.service[120760]: DEBUG nova.api.openstack.wsgi [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Returning 404 to user: Instance ab6cb71c-1735-41c2-be0c-e98a7834df70 could not be found. {{(pid=120760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:57.270411 dv-cinder-master-3-smb devstack@n-api.service[120760]: INFO nova.api.openstack.requestlog [None req-42d7d69f-d0d7-40b9-999b-39af68b2cd0d tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70" status: 404 len: 111 microversion: 2.1 time: 0.033682 Oct 02 01:05:57.270411 dv-cinder-master-3-smb devstack@n-api.service[120760]: [pid: 120760|app: 0|req: 489/965] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:57 2022] GET /compute/v2.1/servers/ab6cb71c-1735-41c2-be0c-e98a7834df70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:57.275790 dv-cinder-master-3-smb devstack@n-api.service[120759]: DEBUG nova.api.openstack.wsgi [None req-964c3818-f210-4463-bccd-2b6bf1ca4e38 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] Calling method '.version_select at 0x7feb047871f0>' {{(pid=120759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.296915 dv-cinder-master-3-smb devstack@n-api.service[120759]: INFO nova.api.openstack.requestlog [None req-964c3818-f210-4463-bccd-2b6bf1ca4e38 tempest-TestMinimumBasicScenario-1363935370 tempest-TestMinimumBasicScenario-1363935370-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654210781" status: 202 len: 0 microversion: 2.1 time: 0.024190 Oct 02 01:05:57.297741 dv-cinder-master-3-smb devstack@n-api.service[120759]: [pid: 120759|app: 0|req: 477/966] 10.222.0.26 () {58 vars in 1269 bytes} [Sun Oct 2 01:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654210781 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)